Jul 28 00:10:03 user nova-compute[70709]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 28 00:10:06 user nova-compute[70709]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=70709) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 28 00:10:06 user nova-compute[70709]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=70709) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 28 00:10:06 user nova-compute[70709]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=70709) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 28 00:10:06 user nova-compute[70709]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 28 00:10:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:10:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:10:06 user nova-compute[70709]: INFO nova.virt.driver [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 28 00:10:07 user nova-compute[70709]: INFO nova.compute.provider_config [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] Acquiring lock "singleton_lock" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] Acquired lock "singleton_lock" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] Releasing lock "singleton_lock" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] Full set of CONF: {{(pid=70709) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ******************************************************************************** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] Configuration options gathered from: {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ================================================================================ {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] allow_resize_to_same_host      = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] arq_binding_timeout            = 300 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] backdoor_port                  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] backdoor_socket                = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] block_device_allocate_retries  = 300 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] block_device_allocate_retries_interval = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cert                           = self.pem {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute_monitors               = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] config_dir                     = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] config_drive_format            = iso9660 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] config_source                  = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] console_host                   = user {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] control_exchange               = nova {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cpu_allocation_ratio           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] daemon                         = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] debug                          = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] default_access_ip_network_name = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] default_availability_zone      = nova {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] default_ephemeral_format       = ext4 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] default_schedule_zone          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] disk_allocation_ratio          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] enable_new_services            = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] enabled_apis                   = ['osapi_compute'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] enabled_ssl_apis               = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] flat_injected                  = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] force_config_drive             = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] force_raw_images               = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] graceful_shutdown_timeout      = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] heal_instance_info_cache_interval = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] host                           = user {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] instance_build_timeout         = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] instance_delete_interval       = 300 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] instance_format                = [instance: %(uuid)s]  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] instance_name_template         = instance-%08x {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] instance_usage_audit           = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] instance_usage_audit_period    = month {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] internal_service_availability_zone = internal {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] key                            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] live_migration_retry_count     = 30 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] log_config_append              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] log_dir                        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] log_file                       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] log_options                    = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] log_rotate_interval            = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] log_rotate_interval_type       = days {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] log_rotation_type              = none {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] long_rpc_timeout               = 1800 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] max_concurrent_builds          = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] max_concurrent_live_migrations = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] max_concurrent_snapshots       = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] max_local_block_devices        = 3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] max_logfile_count              = 30 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] max_logfile_size_mb            = 200 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] maximum_instance_delete_attempts = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] metadata_listen                = 0.0.0.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] metadata_listen_port           = 8775 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] metadata_workers               = 3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] migrate_max_retries            = -1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] mkisofs_cmd                    = genisoimage {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] my_ip                          = 10.0.0.210 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] network_allocate_retries       = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] osapi_compute_listen_port      = 8774 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] osapi_compute_unique_server_name_scope =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] osapi_compute_workers          = 3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] password_length                = 12 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] periodic_enable                = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] periodic_fuzzy_delay           = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] pointer_model                  = ps2mouse {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] preallocate_images             = none {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] publish_errors                 = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] pybasedir                      = /opt/stack/nova {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ram_allocation_ratio           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] rate_limit_burst               = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] rate_limit_except_level        = CRITICAL {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] rate_limit_interval            = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] reboot_timeout                 = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] reclaim_instance_interval      = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] record                         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] reimage_timeout_per_gb         = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] report_interval                = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] rescue_timeout                 = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] reserved_host_cpus             = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] reserved_host_disk_mb          = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] reserved_host_memory_mb        = 512 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] reserved_huge_pages            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] resize_confirm_window          = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] resize_fs_using_block_device   = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] resume_guests_state_on_host_boot = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] rpc_response_timeout           = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] run_external_periodic_tasks    = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] running_deleted_instance_action = reap {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] running_deleted_instance_poll_interval = 1800 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] running_deleted_instance_timeout = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler_instance_sync_interval = 120 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] service_down_time              = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] servicegroup_driver            = db {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] shelved_offload_time           = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] shelved_poll_interval          = 3600 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] shutdown_timeout               = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] source_is_ipv6                 = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ssl_only                       = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] state_path                     = /opt/stack/data/nova {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] sync_power_state_interval      = 600 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] sync_power_state_pool_size     = 1000 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] syslog_log_facility            = LOG_USER {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] tempdir                        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] timeout_nbd                    = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] transport_url                  = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] update_resources_interval      = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] use_cow_images                 = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] use_eventlog                   = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] use_journal                    = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] use_json                       = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] use_rootwrap_daemon            = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] use_stderr                     = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] use_syslog                     = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vcpu_pin_set                   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plugging_is_fatal          = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plugging_timeout           = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] virt_mkfs                      = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] volume_usage_poll_interval     = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] watch_log_file                 = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] web                            = /usr/share/spice-html5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_concurrency.disable_process_locking = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.auth_strategy              = keystone {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.compute_link_prefix        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.dhcp_domain                = novalocal {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.enable_instance_password   = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.glance_link_prefix         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.instance_list_per_project_cells = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.list_records_by_skipping_down_cells = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.local_metadata_per_cell    = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.max_limit                  = 1000 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.metadata_cache_expiration  = 15 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.neutron_default_tenant_id  = default {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.use_forwarded_for          = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.use_neutron_default_nets   = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.vendordata_dynamic_targets = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.vendordata_jsonfile_path   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.backend                  = dogpile.cache.memcached {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.backend_argument         = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.config_prefix            = cache.oslo {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.dead_timeout             = 60.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.debug_cache_backend      = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.enable_retry_client      = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.enable_socket_keepalive  = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.enabled                  = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.expiration_time          = 600 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.hashclient_retry_attempts = 2 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.memcache_dead_retry      = 300 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.memcache_password        =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.memcache_pool_maxsize    = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.memcache_sasl_enabled    = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.memcache_username        =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.proxies                  = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.retry_attempts           = 2 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.retry_delay              = 0.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.socket_keepalive_count   = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.socket_keepalive_idle    = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.socket_keepalive_interval = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.tls_allowed_ciphers      = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.tls_cafile               = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.tls_certfile             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.tls_enabled              = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cache.tls_keyfile              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.auth_section            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.auth_type               = password {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.cafile                  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.certfile                = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.collect_timing          = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.cross_az_attach         = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.debug                   = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.endpoint_template       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.http_retries            = 3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.insecure                = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.keyfile                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.os_region_name          = RegionOne {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.split_loggers           = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cinder.timeout                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.cpu_dedicated_set      = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.cpu_shared_set         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.image_type_exclude_list = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.max_concurrent_disk_ops = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.max_disk_devices_to_attach = -1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.resource_provider_association_refresh = 300 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.shutdown_retry_interval = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] conductor.workers              = 3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] console.allowed_origins        = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] console.ssl_ciphers            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] console.ssl_minimum_version    = default {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] consoleauth.token_ttl          = 600 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.cafile                  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.certfile                = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.collect_timing          = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.connect_retries         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.connect_retry_delay     = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.endpoint_override       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.insecure                = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.keyfile                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.max_version             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.min_version             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.region_name             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.service_name            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.service_type            = accelerator {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.split_loggers           = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.status_code_retries     = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.status_code_retry_delay = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.timeout                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] cyborg.version                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.backend               = sqlalchemy {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.connection            = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.connection_debug      = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.connection_parameters =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.connection_recycle_time = 3600 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.connection_trace      = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.db_inc_retry_interval = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.db_max_retries        = 20 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.db_max_retry_interval = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.db_retry_interval     = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.max_overflow          = 50 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.max_pool_size         = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.max_retries           = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.mysql_enable_ndb      = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.mysql_wsrep_sync_wait = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.pool_timeout          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.retry_interval        = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.slave_connection      = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] database.sqlite_synchronous    = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.backend           = sqlalchemy {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.connection        = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.connection_debug  = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.connection_parameters =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.connection_recycle_time = 3600 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.connection_trace  = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.db_inc_retry_interval = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.db_max_retries    = 20 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.db_max_retry_interval = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.db_retry_interval = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.max_overflow      = 50 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.max_pool_size     = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.max_retries       = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.mysql_enable_ndb  = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.pool_timeout      = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.retry_interval    = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.slave_connection  = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] api_database.sqlite_synchronous = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] devices.enabled_mdev_types     = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ephemeral_storage_encryption.enabled = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.api_servers             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.cafile                  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.certfile                = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.collect_timing          = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.connect_retries         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.connect_retry_delay     = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.debug                   = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.default_trusted_certificate_ids = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.enable_certificate_validation = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.enable_rbd_download     = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.endpoint_override       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.insecure                = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.keyfile                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.max_version             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.min_version             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.num_retries             = 3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.rbd_ceph_conf           =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.rbd_connect_timeout     = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.rbd_pool                =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.rbd_user                =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.region_name             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.service_name            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.service_type            = image {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.split_loggers           = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.status_code_retries     = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.status_code_retry_delay = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.timeout                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.verify_glance_signatures = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] glance.version                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] guestfs.debug                  = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.config_drive_cdrom      = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.config_drive_inject_password = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.enable_instance_metrics_collection = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.enable_remotefx         = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.instances_path_share    =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.iscsi_initiator_list    = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.limit_cpu_features      = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.power_state_check_timeframe = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.use_multipath_io        = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.volume_attach_retry_count = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.vswitch_name            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] mks.enabled                    = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] image_cache.manager_interval   = 2400 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] image_cache.precache_concurrency = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] image_cache.remove_unused_base_images = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] image_cache.subdirectory_name  = _base {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.api_max_retries         = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.api_retry_interval      = 2 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.auth_section            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.auth_type               = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.cafile                  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.certfile                = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.collect_timing          = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.connect_retries         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.connect_retry_delay     = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.endpoint_override       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.insecure                = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.keyfile                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.max_version             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.min_version             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.partition_key           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.peer_list               = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.region_name             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.serial_console_state_timeout = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.service_name            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.service_type            = baremetal {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.split_loggers           = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.status_code_retries     = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.status_code_retry_delay = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.timeout                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ironic.version                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] key_manager.fixed_key          = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.barbican_api_version  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.barbican_endpoint     = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.barbican_endpoint_type = public {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.barbican_region_name  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.cafile                = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.certfile              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.collect_timing        = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.insecure              = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.keyfile               = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.number_of_retries     = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.retry_delay           = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.send_service_user_token = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.split_loggers         = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.timeout               = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.verify_ssl            = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican.verify_ssl_path       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican_service_user.auth_section = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican_service_user.auth_type = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican_service_user.cafile   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican_service_user.certfile = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican_service_user.collect_timing = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican_service_user.insecure = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican_service_user.keyfile  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican_service_user.split_loggers = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] barbican_service_user.timeout  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.approle_role_id          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.approle_secret_id        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.cafile                   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.certfile                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.collect_timing           = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.insecure                 = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.keyfile                  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.kv_mountpoint            = secret {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.kv_version               = 2 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.namespace                = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.root_token_id            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.split_loggers            = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.ssl_ca_crt_file          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.timeout                  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.use_ssl                  = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.cafile                = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.certfile              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.collect_timing        = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.connect_retries       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.connect_retry_delay   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.endpoint_override     = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.insecure              = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.keyfile               = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.max_version           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.min_version           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.region_name           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.service_name          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.service_type          = identity {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.split_loggers         = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.status_code_retries   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.status_code_retry_delay = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.timeout               = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] keystone.version               = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.connection_uri         =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.cpu_mode               = custom {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: WARNING oslo_config.cfg [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.cpu_power_governor_high = performance {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.cpu_power_governor_low = powersave {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.cpu_power_management   = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.device_detach_attempts = 8 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.device_detach_timeout  = 20 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.disk_cachemodes        = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.disk_prefix            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.enabled_perf_events    = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.file_backed_memory     = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.gid_maps               = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.hw_disk_discard        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.hw_machine_type        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.images_rbd_glance_store_name =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.images_rbd_pool        = rbd {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.images_type            = default {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.images_volume_group    = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.inject_key             = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.inject_partition       = -2 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.inject_password        = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.iscsi_iface            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.iser_use_multipath     = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_bandwidth = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_downtime = 500 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_inbound_addr = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_permit_post_copy = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_scheme  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_timeout_action = abort {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_tunnelled = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: WARNING oslo_config.cfg [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 28 00:10:07 user nova-compute[70709]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 28 00:10:07 user nova-compute[70709]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 28 00:10:07 user nova-compute[70709]: and ``live_migration_inbound_addr`` respectively.
Jul 28 00:10:07 user nova-compute[70709]: ).  Its value may be silently ignored in the future.
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.live_migration_with_native_tls = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.max_queues             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.nfs_mount_options      = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.num_memory_encrypted_guests = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.num_pcie_ports         = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.pmem_namespaces        = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.quobyte_client_cfg     = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.rbd_secret_uuid        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.rbd_user               = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.remote_filesystem_transport = ssh {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.rescue_image_id        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.rescue_kernel_id       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.rescue_ramdisk_id      = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.rx_queue_size          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.smbfs_mount_options    =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.snapshot_compression   = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.snapshot_image_format  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.sparse_logical_volumes = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.swtpm_enabled          = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.swtpm_group            = tss {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.swtpm_user             = tss {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.sysinfo_serial         = unique {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.tb_cache_size          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.tx_queue_size          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.uid_maps               = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.use_virtio_for_bridges = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.virt_type              = kvm {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.volume_clear           = zero {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.volume_clear_size      = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.volume_use_multipath   = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.vzstorage_cache_path   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.vzstorage_mount_user   = stack {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.auth_section           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.auth_type              = password {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.cafile                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.certfile               = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.collect_timing         = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.connect_retries        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.connect_retry_delay    = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.default_floating_pool  = public {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.endpoint_override      = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.extension_sync_interval = 600 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.http_retries           = 3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.insecure               = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.keyfile                = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.max_version            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.min_version            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.ovs_bridge             = br-int {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.physnets               = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.region_name            = RegionOne {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.service_metadata_proxy = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.service_name           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.service_type           = network {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.split_loggers          = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.status_code_retries    = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.status_code_retry_delay = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.timeout                = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] neutron.version                = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] notifications.bdms_in_notifications = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] notifications.default_level    = INFO {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] notifications.notification_format = unversioned {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] notifications.notify_on_state_change = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] pci.alias                      = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] pci.device_spec                = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] pci.report_in_placement        = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.auth_section         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.auth_type            = password {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.cafile               = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.certfile             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.collect_timing       = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.connect_retries      = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.connect_retry_delay  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.default_domain_id    = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.default_domain_name  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.domain_id            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.domain_name          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.endpoint_override    = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.insecure             = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.keyfile              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.max_version          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.min_version          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.password             = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.project_domain_id    = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.project_domain_name  = Default {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.project_id           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.project_name         = service {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.region_name          = RegionOne {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.service_name         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.service_type         = placement {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.split_loggers        = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.status_code_retries  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.status_code_retry_delay = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.system_scope         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.timeout              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.trust_id             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.user_domain_id       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.user_domain_name     = Default {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.user_id              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.username             = placement {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] placement.version              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.cores                    = 20 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.count_usage_from_placement = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.injected_file_content_bytes = 10240 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.injected_file_path_length = 255 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.injected_files           = 5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.instances                = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.key_pairs                = 100 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.metadata_items           = 128 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.ram                      = 51200 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.recheck_quota            = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.server_group_members     = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] quota.server_groups            = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] rdp.enabled                    = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler.image_metadata_prefilter = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler.max_attempts         = 3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler.max_placement_results = 1000 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler.query_placement_for_availability_zone = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler.query_placement_for_image_type_support = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] scheduler.workers              = 3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.host_subset_size = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.isolated_hosts = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.isolated_images = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.pci_in_placement = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.track_instance_changes = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] metrics.required               = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] metrics.weight_multiplier      = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] metrics.weight_setting         = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] serial_console.enabled         = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] serial_console.port_range      = 10000:20000 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] serial_console.serialproxy_port = 6083 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] service_user.auth_section      = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] service_user.auth_type         = password {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] service_user.cafile            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] service_user.certfile          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] service_user.collect_timing    = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] service_user.insecure          = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] service_user.keyfile           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] service_user.send_service_user_token = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] service_user.split_loggers     = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] service_user.timeout           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.agent_enabled            = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.enabled                  = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.html5proxy_port          = 6082 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.image_compression        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.jpeg_compression         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.playback_compression     = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.server_listen            = 127.0.0.1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.streaming_mode           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] spice.zlib_compression         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] upgrade_levels.baseapi         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] upgrade_levels.cert            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] upgrade_levels.compute         = auto {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] upgrade_levels.conductor       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] upgrade_levels.scheduler       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vendordata_dynamic_auth.auth_section = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vendordata_dynamic_auth.auth_type = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vendordata_dynamic_auth.cafile = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vendordata_dynamic_auth.certfile = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vendordata_dynamic_auth.insecure = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vendordata_dynamic_auth.keyfile = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vendordata_dynamic_auth.timeout = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.api_retry_count         = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.ca_file                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.cache_prefix            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.cluster_name            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.connection_pool_size    = 10 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.console_delay_seconds   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.datastore_regex         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.host_ip                 = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.host_password           = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.host_port               = 443 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.host_username           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.insecure                = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.integration_bridge      = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.maximum_objects         = 100 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.pbm_default_policy      = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.pbm_enabled             = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.pbm_wsdl_location       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.serial_port_proxy_uri   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.serial_port_service_uri = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.task_poll_interval      = 0.5 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.use_linked_clone        = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.vnc_keymap              = en-us {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.vnc_port                = 5900 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vmware.vnc_port_total          = 10000 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vnc.auth_schemes               = ['none'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vnc.enabled                    = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vnc.novncproxy_port            = 6080 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vnc.server_listen              = 0.0.0.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vnc.vencrypt_ca_certs          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vnc.vencrypt_client_cert       = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vnc.vencrypt_client_key        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.disable_rootwrap   = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.enable_numa_live_migration = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.libvirt_disable_apic = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] wsgi.client_socket_timeout     = 900 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] wsgi.default_pool_size         = 1000 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] wsgi.keep_alive                = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] wsgi.max_header_line           = 16384 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] wsgi.ssl_ca_file               = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] wsgi.ssl_cert_file             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] wsgi.ssl_key_file              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] wsgi.tcp_keepidle              = 600 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] zvm.ca_file                    = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] zvm.cloud_connector_url        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] zvm.reachable_timeout          = 300 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_policy.enforce_new_defaults = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_policy.enforce_scope      = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_policy.policy_default_rule = default {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_policy.policy_file        = policy.yaml {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler.connection_string     = messaging:// {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler.enabled               = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler.es_doc_type           = notification {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler.es_scroll_size        = 10000 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler.es_scroll_time        = 2m {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler.filter_error_trace    = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler.hmac_keys             = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler.sentinel_service_name = mymaster {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler.socket_timeout        = 0.1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler.trace_requests        = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler.trace_sqlalchemy      = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler_jaeger.process_tags   = {} {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler_jaeger.service_name_prefix = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] profiler_otlp.service_name_prefix = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] remote_debug.host              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] remote_debug.port              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.ssl      = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_notifications.retry = -1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.auth_section        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.auth_type           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.cafile              = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.certfile            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.collect_timing      = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.connect_retries     = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.connect_retry_delay = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.endpoint_id         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.endpoint_override   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.insecure            = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.keyfile             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.max_version         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.min_version         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.region_name         = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.service_name        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.service_type        = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.split_loggers       = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.status_code_retries = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.status_code_retry_delay = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.timeout             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.valid_interfaces    = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_limit.version             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_reports.file_event_handler = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] oslo_reports.log_dir           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_ovs_privileged.group  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] vif_plug_ovs_privileged.user   = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_linux_bridge.flat_interface = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_ovs.isolate_vif         = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_vif_ovs.per_port_bridge     = False {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] os_brick.lock_path             = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] privsep_osbrick.capabilities   = [21] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] privsep_osbrick.group          = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] privsep_osbrick.helper_command = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] privsep_osbrick.user           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] nova_sys_admin.group           = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] nova_sys_admin.helper_command  = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] nova_sys_admin.user            = None {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG oslo_service.service [None req-8c09f9ed-ad76-4dce-b026-15d152cb2273 None None] ******************************************************************************** {{(pid=70709) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 28 00:10:07 user nova-compute[70709]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 28 00:10:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Starting native event thread {{(pid=70709) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Starting green dispatch thread {{(pid=70709) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Starting connection event dispatch thread {{(pid=70709) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Connecting to libvirt: qemu:///system {{(pid=70709) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f9b990c37f0> {{(pid=70709) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 28 00:10:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f9b990c37f0> {{(pid=70709) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 28 00:10:07 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Connection event '1' reason 'None'
Jul 28 00:10:07 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 28 00:10:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.mount [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Initialising _HostMountState generation 0 {{(pid=70709) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 28 00:10:14 user nova-compute[70709]: INFO nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Libvirt host capabilities <capabilities>
Jul 28 00:10:14 user nova-compute[70709]:   <host>
Jul 28 00:10:14 user nova-compute[70709]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 28 00:10:14 user nova-compute[70709]:     <cpu>
Jul 28 00:10:14 user nova-compute[70709]:       <arch>x86_64</arch>
Jul 28 00:10:14 user nova-compute[70709]:       <model>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <vendor>Intel</vendor>
Jul 28 00:10:14 user nova-compute[70709]:       <microcode version='1070'/>
Jul 28 00:10:14 user nova-compute[70709]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 28 00:10:14 user nova-compute[70709]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='ss'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='vmx'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='pcid'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='osxsave'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='hypervisor'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='arat'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='tsc_adjust'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='md-clear'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='arch-capabilities'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='invtsc'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='rsba'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature name='skip-l1dfl-vmentry'/>
Jul 28 00:10:14 user nova-compute[70709]:       <pages unit='KiB' size='4'/>
Jul 28 00:10:14 user nova-compute[70709]:       <pages unit='KiB' size='2048'/>
Jul 28 00:10:14 user nova-compute[70709]:     </cpu>
Jul 28 00:10:14 user nova-compute[70709]:     <power_management>
Jul 28 00:10:14 user nova-compute[70709]:       <suspend_mem/>
Jul 28 00:10:14 user nova-compute[70709]:       <suspend_disk/>
Jul 28 00:10:14 user nova-compute[70709]:       <suspend_hybrid/>
Jul 28 00:10:14 user nova-compute[70709]:     </power_management>
Jul 28 00:10:14 user nova-compute[70709]:     <iommu support='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     <migration_features>
Jul 28 00:10:14 user nova-compute[70709]:       <live/>
Jul 28 00:10:14 user nova-compute[70709]:       <uri_transports>
Jul 28 00:10:14 user nova-compute[70709]:         <uri_transport>tcp</uri_transport>
Jul 28 00:10:14 user nova-compute[70709]:         <uri_transport>rdma</uri_transport>
Jul 28 00:10:14 user nova-compute[70709]:       </uri_transports>
Jul 28 00:10:14 user nova-compute[70709]:     </migration_features>
Jul 28 00:10:14 user nova-compute[70709]:     <topology>
Jul 28 00:10:14 user nova-compute[70709]:       <cells num='2'>
Jul 28 00:10:14 user nova-compute[70709]:         <cell id='0'>
Jul 28 00:10:14 user nova-compute[70709]:           <memory unit='KiB'>8189224</memory>
Jul 28 00:10:14 user nova-compute[70709]:           <pages unit='KiB' size='4'>2047306</pages>
Jul 28 00:10:14 user nova-compute[70709]:           <pages unit='KiB' size='2048'>0</pages>
Jul 28 00:10:14 user nova-compute[70709]:           <distances>
Jul 28 00:10:14 user nova-compute[70709]:             <sibling id='0' value='10'/>
Jul 28 00:10:14 user nova-compute[70709]:             <sibling id='1' value='20'/>
Jul 28 00:10:14 user nova-compute[70709]:           </distances>
Jul 28 00:10:14 user nova-compute[70709]:           <cpus num='6'>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 28 00:10:14 user nova-compute[70709]:           </cpus>
Jul 28 00:10:14 user nova-compute[70709]:         </cell>
Jul 28 00:10:14 user nova-compute[70709]:         <cell id='1'>
Jul 28 00:10:14 user nova-compute[70709]:           <memory unit='KiB'>8206460</memory>
Jul 28 00:10:14 user nova-compute[70709]:           <pages unit='KiB' size='4'>2051615</pages>
Jul 28 00:10:14 user nova-compute[70709]:           <pages unit='KiB' size='2048'>0</pages>
Jul 28 00:10:14 user nova-compute[70709]:           <distances>
Jul 28 00:10:14 user nova-compute[70709]:             <sibling id='0' value='20'/>
Jul 28 00:10:14 user nova-compute[70709]:             <sibling id='1' value='10'/>
Jul 28 00:10:14 user nova-compute[70709]:           </distances>
Jul 28 00:10:14 user nova-compute[70709]:           <cpus num='6'>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 28 00:10:14 user nova-compute[70709]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 28 00:10:14 user nova-compute[70709]:           </cpus>
Jul 28 00:10:14 user nova-compute[70709]:         </cell>
Jul 28 00:10:14 user nova-compute[70709]:       </cells>
Jul 28 00:10:14 user nova-compute[70709]:     </topology>
Jul 28 00:10:14 user nova-compute[70709]:     <cache>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 28 00:10:14 user nova-compute[70709]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 28 00:10:14 user nova-compute[70709]:     </cache>
Jul 28 00:10:14 user nova-compute[70709]:     <secmodel>
Jul 28 00:10:14 user nova-compute[70709]:       <model>apparmor</model>
Jul 28 00:10:14 user nova-compute[70709]:       <doi>0</doi>
Jul 28 00:10:14 user nova-compute[70709]:     </secmodel>
Jul 28 00:10:14 user nova-compute[70709]:     <secmodel>
Jul 28 00:10:14 user nova-compute[70709]:       <model>dac</model>
Jul 28 00:10:14 user nova-compute[70709]:       <doi>0</doi>
Jul 28 00:10:14 user nova-compute[70709]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 28 00:10:14 user nova-compute[70709]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 28 00:10:14 user nova-compute[70709]:     </secmodel>
Jul 28 00:10:14 user nova-compute[70709]:   </host>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='alpha'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>64</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>clipper</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='armv6l'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>integratorcp</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>borzoi</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>spitz</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>nuri</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>musca-b1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>versatileab</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>kzm</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>musca-a</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>smdkc210</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sx1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>z2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>tosa</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>sabrelite</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>realview-eb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>n810</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>n800</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>versatilepb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>terrier</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mainstone</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>midway</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>musicpal</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>microbit</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>cubieboard</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>verdex</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>netduino2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>raspi2b</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>cheetah</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>highbank</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>akita</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>connex</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>collie</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>raspi0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='armv7l'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>integratorcp</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>borzoi</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>spitz</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>nuri</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>musca-b1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>versatileab</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>kzm</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>musca-a</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>smdkc210</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sx1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>z2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>tosa</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>sabrelite</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>realview-eb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>n810</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>n800</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>versatilepb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>terrier</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mainstone</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>midway</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>musicpal</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>microbit</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>cubieboard</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>verdex</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>netduino2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>raspi2b</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>cheetah</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>highbank</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>akita</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>connex</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>collie</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>raspi0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='aarch64'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>64</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>integratorcp</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>borzoi</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>spitz</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>nuri</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>musca-b1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>versatileab</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>kzm</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>musca-a</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>smdkc210</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sx1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>z2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>tosa</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>sabrelite</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>realview-eb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>n810</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>n800</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>versatilepb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>terrier</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mainstone</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>midway</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>musicpal</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>microbit</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>cubieboard</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>verdex</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>netduino2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>raspi3b</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>raspi2b</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>cheetah</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>highbank</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>akita</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>connex</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>collie</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>raspi0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <acpi default='on' toggle='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='cris'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='i686'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>x-remote</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>isapc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>microvm</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='kvm'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <pae/>
Jul 28 00:10:14 user nova-compute[70709]:       <nonpae/>
Jul 28 00:10:14 user nova-compute[70709]:       <acpi default='on' toggle='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:       <apic default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='m68k'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>an5206</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>q800</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>next-cube</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='microblaze'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='microblazeel'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='mips'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='16'>malta</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mipssim</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='mipsel'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='16'>malta</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mipssim</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='mips64'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>64</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='16'>malta</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mipssim</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>pica61</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>magnum</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='mips64el'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>64</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='16'>malta</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mipssim</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>pica61</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>magnum</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='16'>boston</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='ppc'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>g3beige</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mac99</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>ppce500</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>pegasos2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sam460ex</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>bamboo</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>40p</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>ref405ep</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>taihu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='ppc64'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>64</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2048'>powernv9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>taihu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2048'>powernv10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>ppce500</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>40p</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>pegasos2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>bamboo</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>g3beige</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mac99</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sam460ex</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>ref405ep</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2048'>powernv8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='ppc64le'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>64</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2048'>powernv9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>taihu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2048'>powernv10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>ppce500</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>40p</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>pegasos2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>bamboo</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>g3beige</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>mac99</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sam460ex</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>ref405ep</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2048'>powernv8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='riscv32'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='8'>spike</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>opentitan</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='5'>sifive_u</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sifive_e</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='8'>virt</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='riscv64'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>64</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='8'>spike</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='5'>sifive_u</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>shakti_c</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sifive_e</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='8'>virt</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='s390x'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>64</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='sh4'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>shix</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>r2d</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='sh4eb'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>64</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>shix</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>r2d</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='sparc'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>SS-5</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>SS-20</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>LX</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>SS-4</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>SS-10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>Voyager</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='sparc64'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>64</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sun4u</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>niagara</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>sun4v</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='x86_64'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>64</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>x-remote</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='1'>isapc</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>microvm</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='kvm'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <acpi default='on' toggle='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:       <apic default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='xtensa'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>sim</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>kc705</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>ml605</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>virt</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>lx200</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>lx60</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]:   <guest>
Jul 28 00:10:14 user nova-compute[70709]:     <os_type>hvm</os_type>
Jul 28 00:10:14 user nova-compute[70709]:     <arch name='xtensaeb'>
Jul 28 00:10:14 user nova-compute[70709]:       <wordsize>32</wordsize>
Jul 28 00:10:14 user nova-compute[70709]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='4'>sim</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>kc705</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>ml605</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>virt</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>lx200</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>lx60</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 28 00:10:14 user nova-compute[70709]:       <domain type='qemu'/>
Jul 28 00:10:14 user nova-compute[70709]:     </arch>
Jul 28 00:10:14 user nova-compute[70709]:     <features>
Jul 28 00:10:14 user nova-compute[70709]:       <cpuselection/>
Jul 28 00:10:14 user nova-compute[70709]:       <deviceboot/>
Jul 28 00:10:14 user nova-compute[70709]:       <disksnapshot default='on' toggle='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     </features>
Jul 28 00:10:14 user nova-compute[70709]:   </guest>
Jul 28 00:10:14 user nova-compute[70709]: </capabilities>
Jul 28 00:10:14 user nova-compute[70709]: 
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 28 00:10:14 user nova-compute[70709]: <domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:   <path>/usr/bin/qemu-system-i386</path>
Jul 28 00:10:14 user nova-compute[70709]:   <domain>kvm</domain>
Jul 28 00:10:14 user nova-compute[70709]:   <machine>pc-i440fx-jammy</machine>
Jul 28 00:10:14 user nova-compute[70709]:   <arch>i686</arch>
Jul 28 00:10:14 user nova-compute[70709]:   <vcpu max='255'/>
Jul 28 00:10:14 user nova-compute[70709]:   <iothreads supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:   <os supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='firmware'/>
Jul 28 00:10:14 user nova-compute[70709]:     <loader supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>rom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pflash</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='readonly'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>yes</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='secure'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </loader>
Jul 28 00:10:14 user nova-compute[70709]:   </os>
Jul 28 00:10:14 user nova-compute[70709]:   <cpu>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-passthrough' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='hostPassthroughMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='maximum' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='maximumMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-model' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <vendor>Intel</vendor>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ss'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='vmx'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pcid'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='hypervisor'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arat'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='tsc_adjust'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='umip'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='md-clear'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arch-capabilities'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibpb'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibrs'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='erms'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='xsaveopt'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='lm'/>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='custom' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>qemu64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>qemu32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>phenom</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>n270</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>kvm64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>coreduo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>core2duo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>athlon</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Westmere-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Westmere</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Snowridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Penryn</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G5</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G4</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G1</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Nehalem-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Nehalem</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Rome</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Milan</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-IBPB</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Dhyana</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cooperlake</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Conroe</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>486</model>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:   </cpu>
Jul 28 00:10:14 user nova-compute[70709]:   <memoryBacking supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='sourceType'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>file</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>anonymous</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>memfd</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:   </memoryBacking>
Jul 28 00:10:14 user nova-compute[70709]:   <devices>
Jul 28 00:10:14 user nova-compute[70709]:     <disk supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='diskDevice'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>disk</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cdrom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>floppy</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>lun</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='bus'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ide</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>fdc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sata</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </disk>
Jul 28 00:10:14 user nova-compute[70709]:     <graphics supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sdl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vnc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>spice</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egl-headless</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </graphics>
Jul 28 00:10:14 user nova-compute[70709]:     <video supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='modelType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cirrus</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vmvga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>qxl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>none</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>bochs</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ramfb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </video>
Jul 28 00:10:14 user nova-compute[70709]:     <hostdev supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='mode'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>subsystem</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='startupPolicy'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>default</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>mandatory</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>requisite</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>optional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='subsysType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pci</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='capsType'/>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='pciBackend'/>
Jul 28 00:10:14 user nova-compute[70709]:     </hostdev>
Jul 28 00:10:14 user nova-compute[70709]:     <rng supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>random</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egd</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>builtin</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </rng>
Jul 28 00:10:14 user nova-compute[70709]:     <filesystem supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='driverType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>path</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>handle</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtiofs</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </filesystem>
Jul 28 00:10:14 user nova-compute[70709]:     <tpm supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-tis</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-crb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>passthrough</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>emulator</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </tpm>
Jul 28 00:10:14 user nova-compute[70709]:   </devices>
Jul 28 00:10:14 user nova-compute[70709]:   <features>
Jul 28 00:10:14 user nova-compute[70709]:     <gic supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     <vmcoreinfo supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <genid supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backingStoreInput supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backup supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <sev supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:   </features>
Jul 28 00:10:14 user nova-compute[70709]: </domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:  {{(pid=70709) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 28 00:10:14 user nova-compute[70709]: <domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:   <path>/usr/bin/qemu-system-i386</path>
Jul 28 00:10:14 user nova-compute[70709]:   <domain>kvm</domain>
Jul 28 00:10:14 user nova-compute[70709]:   <machine>pc-q35-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:   <arch>i686</arch>
Jul 28 00:10:14 user nova-compute[70709]:   <vcpu max='288'/>
Jul 28 00:10:14 user nova-compute[70709]:   <iothreads supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:   <os supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='firmware'/>
Jul 28 00:10:14 user nova-compute[70709]:     <loader supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>rom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pflash</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='readonly'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>yes</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='secure'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </loader>
Jul 28 00:10:14 user nova-compute[70709]:   </os>
Jul 28 00:10:14 user nova-compute[70709]:   <cpu>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-passthrough' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='hostPassthroughMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='maximum' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='maximumMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-model' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <vendor>Intel</vendor>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ss'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='vmx'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pcid'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='hypervisor'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arat'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='tsc_adjust'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='umip'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='md-clear'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arch-capabilities'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibpb'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibrs'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='erms'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='xsaveopt'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='lm'/>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='custom' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>qemu64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>qemu32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>phenom</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>n270</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>kvm64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>coreduo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>core2duo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>athlon</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Westmere-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Westmere</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Snowridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Penryn</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G5</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G4</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G1</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Nehalem-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Nehalem</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Rome</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Milan</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-IBPB</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Dhyana</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cooperlake</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Conroe</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>486</model>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:   </cpu>
Jul 28 00:10:14 user nova-compute[70709]:   <memoryBacking supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='sourceType'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>file</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>anonymous</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>memfd</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:   </memoryBacking>
Jul 28 00:10:14 user nova-compute[70709]:   <devices>
Jul 28 00:10:14 user nova-compute[70709]:     <disk supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='diskDevice'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>disk</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cdrom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>floppy</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>lun</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='bus'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>fdc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sata</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </disk>
Jul 28 00:10:14 user nova-compute[70709]:     <graphics supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sdl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vnc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>spice</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egl-headless</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </graphics>
Jul 28 00:10:14 user nova-compute[70709]:     <video supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='modelType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cirrus</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vmvga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>qxl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>none</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>bochs</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ramfb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </video>
Jul 28 00:10:14 user nova-compute[70709]:     <hostdev supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='mode'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>subsystem</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='startupPolicy'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>default</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>mandatory</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>requisite</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>optional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='subsysType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pci</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='capsType'/>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='pciBackend'/>
Jul 28 00:10:14 user nova-compute[70709]:     </hostdev>
Jul 28 00:10:14 user nova-compute[70709]:     <rng supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>random</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egd</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>builtin</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </rng>
Jul 28 00:10:14 user nova-compute[70709]:     <filesystem supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='driverType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>path</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>handle</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtiofs</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </filesystem>
Jul 28 00:10:14 user nova-compute[70709]:     <tpm supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-tis</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-crb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>passthrough</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>emulator</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </tpm>
Jul 28 00:10:14 user nova-compute[70709]:   </devices>
Jul 28 00:10:14 user nova-compute[70709]:   <features>
Jul 28 00:10:14 user nova-compute[70709]:     <gic supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     <vmcoreinfo supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <genid supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backingStoreInput supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backup supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <sev supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:   </features>
Jul 28 00:10:14 user nova-compute[70709]: </domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:  {{(pid=70709) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 28 00:10:14 user nova-compute[70709]: <domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:   <path>/usr/bin/qemu-system-i386</path>
Jul 28 00:10:14 user nova-compute[70709]:   <domain>kvm</domain>
Jul 28 00:10:14 user nova-compute[70709]:   <machine>pc-i440fx-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:   <arch>i686</arch>
Jul 28 00:10:14 user nova-compute[70709]:   <vcpu max='255'/>
Jul 28 00:10:14 user nova-compute[70709]:   <iothreads supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:   <os supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='firmware'/>
Jul 28 00:10:14 user nova-compute[70709]:     <loader supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>rom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pflash</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='readonly'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>yes</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='secure'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </loader>
Jul 28 00:10:14 user nova-compute[70709]:   </os>
Jul 28 00:10:14 user nova-compute[70709]:   <cpu>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-passthrough' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='hostPassthroughMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='maximum' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='maximumMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-model' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <vendor>Intel</vendor>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ss'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='vmx'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pcid'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='hypervisor'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arat'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='tsc_adjust'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='umip'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='md-clear'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arch-capabilities'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibpb'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibrs'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='erms'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='xsaveopt'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='lm'/>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='custom' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>qemu64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>qemu32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>phenom</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>n270</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>kvm64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>coreduo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>core2duo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>athlon</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Westmere-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Westmere</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Snowridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Penryn</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G5</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G4</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G1</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Nehalem-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Nehalem</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Rome</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Milan</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-IBPB</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Dhyana</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cooperlake</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Conroe</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>486</model>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:   </cpu>
Jul 28 00:10:14 user nova-compute[70709]:   <memoryBacking supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='sourceType'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>file</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>anonymous</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>memfd</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:   </memoryBacking>
Jul 28 00:10:14 user nova-compute[70709]:   <devices>
Jul 28 00:10:14 user nova-compute[70709]:     <disk supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='diskDevice'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>disk</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cdrom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>floppy</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>lun</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='bus'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ide</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>fdc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sata</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </disk>
Jul 28 00:10:14 user nova-compute[70709]:     <graphics supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sdl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vnc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>spice</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egl-headless</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </graphics>
Jul 28 00:10:14 user nova-compute[70709]:     <video supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='modelType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cirrus</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vmvga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>qxl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>none</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>bochs</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ramfb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </video>
Jul 28 00:10:14 user nova-compute[70709]:     <hostdev supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='mode'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>subsystem</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='startupPolicy'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>default</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>mandatory</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>requisite</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>optional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='subsysType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pci</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='capsType'/>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='pciBackend'/>
Jul 28 00:10:14 user nova-compute[70709]:     </hostdev>
Jul 28 00:10:14 user nova-compute[70709]:     <rng supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>random</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egd</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>builtin</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </rng>
Jul 28 00:10:14 user nova-compute[70709]:     <filesystem supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='driverType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>path</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>handle</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtiofs</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </filesystem>
Jul 28 00:10:14 user nova-compute[70709]:     <tpm supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-tis</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-crb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>passthrough</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>emulator</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </tpm>
Jul 28 00:10:14 user nova-compute[70709]:   </devices>
Jul 28 00:10:14 user nova-compute[70709]:   <features>
Jul 28 00:10:14 user nova-compute[70709]:     <gic supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     <vmcoreinfo supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <genid supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backingStoreInput supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backup supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <sev supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:   </features>
Jul 28 00:10:14 user nova-compute[70709]: </domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:  {{(pid=70709) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 28 00:10:14 user nova-compute[70709]: <domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:   <path>/usr/bin/qemu-system-i386</path>
Jul 28 00:10:14 user nova-compute[70709]:   <domain>kvm</domain>
Jul 28 00:10:14 user nova-compute[70709]:   <machine>pc-q35-jammy</machine>
Jul 28 00:10:14 user nova-compute[70709]:   <arch>i686</arch>
Jul 28 00:10:14 user nova-compute[70709]:   <vcpu max='288'/>
Jul 28 00:10:14 user nova-compute[70709]:   <iothreads supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:   <os supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='firmware'/>
Jul 28 00:10:14 user nova-compute[70709]:     <loader supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>rom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pflash</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='readonly'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>yes</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='secure'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </loader>
Jul 28 00:10:14 user nova-compute[70709]:   </os>
Jul 28 00:10:14 user nova-compute[70709]:   <cpu>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-passthrough' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='hostPassthroughMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='maximum' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='maximumMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-model' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <vendor>Intel</vendor>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ss'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='vmx'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pcid'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='hypervisor'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arat'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='tsc_adjust'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='umip'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='md-clear'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arch-capabilities'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibpb'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibrs'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='erms'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='xsaveopt'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='lm'/>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='custom' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>qemu64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>qemu32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>phenom</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>n270</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>kvm64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>coreduo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>core2duo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>athlon</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Westmere-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Westmere</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Snowridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Penryn</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G5</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G4</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G1</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Nehalem-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Nehalem</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Rome</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Milan</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-IBPB</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Dhyana</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cooperlake</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Conroe</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>486</model>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:   </cpu>
Jul 28 00:10:14 user nova-compute[70709]:   <memoryBacking supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='sourceType'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>file</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>anonymous</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>memfd</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:   </memoryBacking>
Jul 28 00:10:14 user nova-compute[70709]:   <devices>
Jul 28 00:10:14 user nova-compute[70709]:     <disk supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='diskDevice'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>disk</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cdrom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>floppy</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>lun</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='bus'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>fdc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sata</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </disk>
Jul 28 00:10:14 user nova-compute[70709]:     <graphics supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sdl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vnc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>spice</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egl-headless</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </graphics>
Jul 28 00:10:14 user nova-compute[70709]:     <video supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='modelType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cirrus</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vmvga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>qxl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>none</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>bochs</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ramfb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </video>
Jul 28 00:10:14 user nova-compute[70709]:     <hostdev supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='mode'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>subsystem</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='startupPolicy'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>default</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>mandatory</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>requisite</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>optional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='subsysType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pci</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='capsType'/>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='pciBackend'/>
Jul 28 00:10:14 user nova-compute[70709]:     </hostdev>
Jul 28 00:10:14 user nova-compute[70709]:     <rng supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>random</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egd</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>builtin</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </rng>
Jul 28 00:10:14 user nova-compute[70709]:     <filesystem supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='driverType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>path</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>handle</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtiofs</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </filesystem>
Jul 28 00:10:14 user nova-compute[70709]:     <tpm supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-tis</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-crb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>passthrough</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>emulator</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </tpm>
Jul 28 00:10:14 user nova-compute[70709]:   </devices>
Jul 28 00:10:14 user nova-compute[70709]:   <features>
Jul 28 00:10:14 user nova-compute[70709]:     <gic supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     <vmcoreinfo supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <genid supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backingStoreInput supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backup supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <sev supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:   </features>
Jul 28 00:10:14 user nova-compute[70709]: </domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:  {{(pid=70709) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 28 00:10:14 user nova-compute[70709]: <domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 28 00:10:14 user nova-compute[70709]:   <domain>kvm</domain>
Jul 28 00:10:14 user nova-compute[70709]:   <machine>pc-i440fx-jammy</machine>
Jul 28 00:10:14 user nova-compute[70709]:   <arch>x86_64</arch>
Jul 28 00:10:14 user nova-compute[70709]:   <vcpu max='255'/>
Jul 28 00:10:14 user nova-compute[70709]:   <iothreads supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:   <os supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='firmware'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>efi</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:     <loader supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>rom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pflash</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='readonly'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>yes</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='secure'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </loader>
Jul 28 00:10:14 user nova-compute[70709]:   </os>
Jul 28 00:10:14 user nova-compute[70709]:   <cpu>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-passthrough' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='hostPassthroughMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='maximum' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='maximumMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-model' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <vendor>Intel</vendor>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ss'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='vmx'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pcid'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='hypervisor'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arat'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='tsc_adjust'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='umip'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='md-clear'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arch-capabilities'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='invtsc'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibpb'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibrs'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='rsba'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pschange-mc-no'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='erms'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='xsaveopt'/>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='custom' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>qemu64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>qemu32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>phenom</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>n270</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>coreduo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>core2duo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>athlon</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Westmere-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Westmere</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Snowridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Penryn</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G5</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G4</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Opteron_G1</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Nehalem</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Rome</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Milan</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-IBPB</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Dhyana</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cooperlake</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Conroe</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>486</model>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:   </cpu>
Jul 28 00:10:14 user nova-compute[70709]:   <memoryBacking supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='sourceType'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>file</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>anonymous</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>memfd</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:   </memoryBacking>
Jul 28 00:10:14 user nova-compute[70709]:   <devices>
Jul 28 00:10:14 user nova-compute[70709]:     <disk supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='diskDevice'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>disk</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cdrom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>floppy</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>lun</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='bus'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ide</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>fdc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sata</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </disk>
Jul 28 00:10:14 user nova-compute[70709]:     <graphics supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sdl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vnc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>spice</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egl-headless</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </graphics>
Jul 28 00:10:14 user nova-compute[70709]:     <video supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='modelType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cirrus</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vmvga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>qxl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>none</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>bochs</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ramfb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </video>
Jul 28 00:10:14 user nova-compute[70709]:     <hostdev supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='mode'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>subsystem</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='startupPolicy'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>default</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>mandatory</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>requisite</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>optional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='subsysType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pci</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='capsType'/>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='pciBackend'/>
Jul 28 00:10:14 user nova-compute[70709]:     </hostdev>
Jul 28 00:10:14 user nova-compute[70709]:     <rng supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>random</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egd</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>builtin</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </rng>
Jul 28 00:10:14 user nova-compute[70709]:     <filesystem supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='driverType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>path</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>handle</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtiofs</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </filesystem>
Jul 28 00:10:14 user nova-compute[70709]:     <tpm supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-tis</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-crb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>passthrough</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>emulator</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </tpm>
Jul 28 00:10:14 user nova-compute[70709]:   </devices>
Jul 28 00:10:14 user nova-compute[70709]:   <features>
Jul 28 00:10:14 user nova-compute[70709]:     <gic supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     <vmcoreinfo supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <genid supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backingStoreInput supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backup supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <sev supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:   </features>
Jul 28 00:10:14 user nova-compute[70709]: </domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:  {{(pid=70709) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 28 00:10:14 user nova-compute[70709]: <domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 28 00:10:14 user nova-compute[70709]:   <domain>kvm</domain>
Jul 28 00:10:14 user nova-compute[70709]:   <machine>pc-q35-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:   <arch>x86_64</arch>
Jul 28 00:10:14 user nova-compute[70709]:   <vcpu max='288'/>
Jul 28 00:10:14 user nova-compute[70709]:   <iothreads supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:   <os supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='firmware'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>efi</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:     <loader supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>rom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pflash</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='readonly'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>yes</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='secure'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>yes</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </loader>
Jul 28 00:10:14 user nova-compute[70709]:   </os>
Jul 28 00:10:14 user nova-compute[70709]:   <cpu>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-passthrough' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='hostPassthroughMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='maximum' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='maximumMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-model' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <vendor>Intel</vendor>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ss'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='vmx'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pcid'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='hypervisor'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arat'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='tsc_adjust'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='umip'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='md-clear'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arch-capabilities'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='invtsc'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibpb'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibrs'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='rsba'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pschange-mc-no'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='erms'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='xsaveopt'/>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='custom' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>qemu64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>qemu32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>phenom</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>n270</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>coreduo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>core2duo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>athlon</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Westmere-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Westmere</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Snowridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Penryn</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G5</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G4</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Opteron_G1</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Nehalem</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Rome</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Milan</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-IBPB</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Dhyana</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cooperlake</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Conroe</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>486</model>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:   </cpu>
Jul 28 00:10:14 user nova-compute[70709]:   <memoryBacking supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='sourceType'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>file</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>anonymous</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>memfd</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:   </memoryBacking>
Jul 28 00:10:14 user nova-compute[70709]:   <devices>
Jul 28 00:10:14 user nova-compute[70709]:     <disk supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='diskDevice'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>disk</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cdrom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>floppy</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>lun</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='bus'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>fdc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sata</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </disk>
Jul 28 00:10:14 user nova-compute[70709]:     <graphics supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sdl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vnc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>spice</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egl-headless</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </graphics>
Jul 28 00:10:14 user nova-compute[70709]:     <video supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='modelType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cirrus</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vmvga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>qxl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>none</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>bochs</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ramfb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </video>
Jul 28 00:10:14 user nova-compute[70709]:     <hostdev supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='mode'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>subsystem</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='startupPolicy'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>default</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>mandatory</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>requisite</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>optional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='subsysType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pci</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='capsType'/>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='pciBackend'/>
Jul 28 00:10:14 user nova-compute[70709]:     </hostdev>
Jul 28 00:10:14 user nova-compute[70709]:     <rng supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>random</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egd</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>builtin</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </rng>
Jul 28 00:10:14 user nova-compute[70709]:     <filesystem supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='driverType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>path</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>handle</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtiofs</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </filesystem>
Jul 28 00:10:14 user nova-compute[70709]:     <tpm supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-tis</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-crb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>passthrough</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>emulator</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </tpm>
Jul 28 00:10:14 user nova-compute[70709]:   </devices>
Jul 28 00:10:14 user nova-compute[70709]:   <features>
Jul 28 00:10:14 user nova-compute[70709]:     <gic supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     <vmcoreinfo supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <genid supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backingStoreInput supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backup supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <sev supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:   </features>
Jul 28 00:10:14 user nova-compute[70709]: </domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:  {{(pid=70709) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 28 00:10:14 user nova-compute[70709]: <domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 28 00:10:14 user nova-compute[70709]:   <domain>kvm</domain>
Jul 28 00:10:14 user nova-compute[70709]:   <machine>pc-i440fx-6.2</machine>
Jul 28 00:10:14 user nova-compute[70709]:   <arch>x86_64</arch>
Jul 28 00:10:14 user nova-compute[70709]:   <vcpu max='255'/>
Jul 28 00:10:14 user nova-compute[70709]:   <iothreads supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:   <os supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='firmware'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>efi</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:     <loader supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>rom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pflash</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='readonly'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>yes</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='secure'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </loader>
Jul 28 00:10:14 user nova-compute[70709]:   </os>
Jul 28 00:10:14 user nova-compute[70709]:   <cpu>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-passthrough' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='hostPassthroughMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='maximum' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='maximumMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-model' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <vendor>Intel</vendor>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ss'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='vmx'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pcid'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='hypervisor'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arat'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='tsc_adjust'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='umip'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='md-clear'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arch-capabilities'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='invtsc'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibpb'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibrs'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='rsba'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pschange-mc-no'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='erms'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='xsaveopt'/>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='custom' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>qemu64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>qemu32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>phenom</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>n270</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>coreduo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>core2duo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>athlon</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Westmere-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Westmere</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Snowridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Penryn</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G5</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G4</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Opteron_G1</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Nehalem</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Rome</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Milan</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-IBPB</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Dhyana</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cooperlake</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Conroe</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>486</model>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:   </cpu>
Jul 28 00:10:14 user nova-compute[70709]:   <memoryBacking supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='sourceType'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>file</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>anonymous</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>memfd</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:   </memoryBacking>
Jul 28 00:10:14 user nova-compute[70709]:   <devices>
Jul 28 00:10:14 user nova-compute[70709]:     <disk supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='diskDevice'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>disk</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cdrom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>floppy</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>lun</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='bus'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ide</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>fdc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sata</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </disk>
Jul 28 00:10:14 user nova-compute[70709]:     <graphics supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sdl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vnc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>spice</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egl-headless</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </graphics>
Jul 28 00:10:14 user nova-compute[70709]:     <video supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='modelType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cirrus</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vmvga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>qxl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>none</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>bochs</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ramfb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </video>
Jul 28 00:10:14 user nova-compute[70709]:     <hostdev supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='mode'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>subsystem</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='startupPolicy'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>default</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>mandatory</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>requisite</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>optional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='subsysType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pci</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='capsType'/>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='pciBackend'/>
Jul 28 00:10:14 user nova-compute[70709]:     </hostdev>
Jul 28 00:10:14 user nova-compute[70709]:     <rng supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>random</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egd</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>builtin</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </rng>
Jul 28 00:10:14 user nova-compute[70709]:     <filesystem supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='driverType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>path</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>handle</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtiofs</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </filesystem>
Jul 28 00:10:14 user nova-compute[70709]:     <tpm supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-tis</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-crb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>passthrough</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>emulator</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </tpm>
Jul 28 00:10:14 user nova-compute[70709]:   </devices>
Jul 28 00:10:14 user nova-compute[70709]:   <features>
Jul 28 00:10:14 user nova-compute[70709]:     <gic supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     <vmcoreinfo supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <genid supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backingStoreInput supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backup supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <sev supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:   </features>
Jul 28 00:10:14 user nova-compute[70709]: </domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:  {{(pid=70709) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 28 00:10:14 user nova-compute[70709]: <domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 28 00:10:14 user nova-compute[70709]:   <domain>kvm</domain>
Jul 28 00:10:14 user nova-compute[70709]:   <machine>pc-q35-jammy</machine>
Jul 28 00:10:14 user nova-compute[70709]:   <arch>x86_64</arch>
Jul 28 00:10:14 user nova-compute[70709]:   <vcpu max='288'/>
Jul 28 00:10:14 user nova-compute[70709]:   <iothreads supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:   <os supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='firmware'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>efi</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:     <loader supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>rom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pflash</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='readonly'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>yes</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='secure'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>yes</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>no</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </loader>
Jul 28 00:10:14 user nova-compute[70709]:   </os>
Jul 28 00:10:14 user nova-compute[70709]:   <cpu>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-passthrough' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='hostPassthroughMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='maximum' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='maximumMigratable'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>on</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>off</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='host-model' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <vendor>Intel</vendor>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ss'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='vmx'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pcid'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='hypervisor'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arat'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='tsc_adjust'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='umip'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='md-clear'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='arch-capabilities'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='invtsc'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibpb'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='ibrs'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-stibp'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='amd-ssbd'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='rsba'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='require' name='pschange-mc-no'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='erms'/>
Jul 28 00:10:14 user nova-compute[70709]:       <feature policy='disable' name='xsaveopt'/>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:     <mode name='custom' supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>qemu64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>qemu32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>phenom</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>pentium</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>n270</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm64</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>kvm32</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>coreduo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>core2duo</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>athlon</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Westmere-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Westmere</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Snowridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Skylake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>SandyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Penryn</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G5</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G4</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G3</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Opteron_G2</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Opteron_G1</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Nehalem</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>IvyBridge</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Icelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Haswell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Rome</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-Milan</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC-IBPB</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>EPYC</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Dhyana</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cooperlake</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>Conroe</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Cascadelake-Server</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-noTSX</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell-IBRS</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='no'>Broadwell</model>
Jul 28 00:10:14 user nova-compute[70709]:       <model usable='yes'>486</model>
Jul 28 00:10:14 user nova-compute[70709]:     </mode>
Jul 28 00:10:14 user nova-compute[70709]:   </cpu>
Jul 28 00:10:14 user nova-compute[70709]:   <memoryBacking supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:     <enum name='sourceType'>
Jul 28 00:10:14 user nova-compute[70709]:       <value>file</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>anonymous</value>
Jul 28 00:10:14 user nova-compute[70709]:       <value>memfd</value>
Jul 28 00:10:14 user nova-compute[70709]:     </enum>
Jul 28 00:10:14 user nova-compute[70709]:   </memoryBacking>
Jul 28 00:10:14 user nova-compute[70709]:   <devices>
Jul 28 00:10:14 user nova-compute[70709]:     <disk supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='diskDevice'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>disk</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cdrom</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>floppy</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>lun</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='bus'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>fdc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sata</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </disk>
Jul 28 00:10:14 user nova-compute[70709]:     <graphics supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='type'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>sdl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vnc</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>spice</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egl-headless</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </graphics>
Jul 28 00:10:14 user nova-compute[70709]:     <video supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='modelType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>cirrus</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>vmvga</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>qxl</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>none</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>bochs</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>ramfb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </video>
Jul 28 00:10:14 user nova-compute[70709]:     <hostdev supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='mode'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>subsystem</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='startupPolicy'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>default</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>mandatory</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>requisite</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>optional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='subsysType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>usb</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>pci</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>scsi</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='capsType'/>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='pciBackend'/>
Jul 28 00:10:14 user nova-compute[70709]:     </hostdev>
Jul 28 00:10:14 user nova-compute[70709]:     <rng supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtio-non-transitional</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>random</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>egd</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>builtin</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </rng>
Jul 28 00:10:14 user nova-compute[70709]:     <filesystem supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='driverType'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>path</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>handle</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>virtiofs</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </filesystem>
Jul 28 00:10:14 user nova-compute[70709]:     <tpm supported='yes'>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='model'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-tis</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>tpm-crb</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:       <enum name='backendModel'>
Jul 28 00:10:14 user nova-compute[70709]:         <value>passthrough</value>
Jul 28 00:10:14 user nova-compute[70709]:         <value>emulator</value>
Jul 28 00:10:14 user nova-compute[70709]:       </enum>
Jul 28 00:10:14 user nova-compute[70709]:     </tpm>
Jul 28 00:10:14 user nova-compute[70709]:   </devices>
Jul 28 00:10:14 user nova-compute[70709]:   <features>
Jul 28 00:10:14 user nova-compute[70709]:     <gic supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:     <vmcoreinfo supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <genid supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backingStoreInput supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <backup supported='yes'/>
Jul 28 00:10:14 user nova-compute[70709]:     <sev supported='no'/>
Jul 28 00:10:14 user nova-compute[70709]:   </features>
Jul 28 00:10:14 user nova-compute[70709]: </domainCapabilities>
Jul 28 00:10:14 user nova-compute[70709]:  {{(pid=70709) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=70709) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=70709) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Checking secure boot support for host arch (x86_64) {{(pid=70709) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Checking secure boot support for host arch (x86_64) {{(pid=70709) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Checking secure boot support for host arch (x86_64) {{(pid=70709) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 28 00:10:14 user nova-compute[70709]: INFO nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Secure Boot support detected
Jul 28 00:10:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] cpu compare xml: <cpu match="exact">
Jul 28 00:10:14 user nova-compute[70709]:   <model>Nehalem</model>
Jul 28 00:10:14 user nova-compute[70709]: </cpu>
Jul 28 00:10:14 user nova-compute[70709]:  {{(pid=70709) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 28 00:10:14 user nova-compute[70709]: INFO nova.virt.node [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Generated node identity 4612f42c-a702-4177-9388-c9bc6a4c0da1
Jul 28 00:10:14 user nova-compute[70709]: INFO nova.virt.node [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Wrote node identity 4612f42c-a702-4177-9388-c9bc6a4c0da1 to /opt/stack/data/nova/compute_id
Jul 28 00:10:14 user nova-compute[70709]: WARNING nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Compute nodes ['4612f42c-a702-4177-9388-c9bc6a4c0da1'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 28 00:10:15 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 28 00:10:15 user nova-compute[70709]: WARNING nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 28 00:10:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:10:15 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:10:15 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Hypervisor/Node resource view: name=user free_ram=10908MB free_disk=26.269775390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:10:15 user nova-compute[70709]: WARNING nova.compute.resource_tracker [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] No compute node record for user:4612f42c-a702-4177-9388-c9bc6a4c0da1: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 4612f42c-a702-4177-9388-c9bc6a4c0da1 could not be found.
Jul 28 00:10:15 user nova-compute[70709]: INFO nova.compute.resource_tracker [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Compute node record created for user:user with uuid: 4612f42c-a702-4177-9388-c9bc6a4c0da1
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:10:15 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [req-64367d7e-3246-4b77-8a58-bd599f923078] Created resource provider record via placement API for resource provider with UUID 4612f42c-a702-4177-9388-c9bc6a4c0da1 and name user.
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=70709) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 28 00:10:15 user nova-compute[70709]: INFO nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] kernel doesn't support AMD SEV
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Libvirt baseline CPU <cpu>
Jul 28 00:10:15 user nova-compute[70709]:   <arch>x86_64</arch>
Jul 28 00:10:15 user nova-compute[70709]:   <model>Nehalem</model>
Jul 28 00:10:15 user nova-compute[70709]:   <vendor>Intel</vendor>
Jul 28 00:10:15 user nova-compute[70709]:   <topology sockets="6" cores="1" threads="1"/>
Jul 28 00:10:15 user nova-compute[70709]: </cpu>
Jul 28 00:10:15 user nova-compute[70709]:  {{(pid=70709) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Updated inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Updating resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 generation from 0 to 1 during operation: update_inventory {{(pid=70709) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 00:10:15 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Updating resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 generation from 1 to 2 during operation: update_traits {{(pid=70709) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 28 00:10:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:10:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:10:16 user nova-compute[70709]: DEBUG nova.service [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Creating RPC server for service compute {{(pid=70709) start /opt/stack/nova/nova/service.py:182}}
Jul 28 00:10:16 user nova-compute[70709]: DEBUG nova.service [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Join ServiceGroup membership for this service compute {{(pid=70709) start /opt/stack/nova/nova/service.py:199}}
Jul 28 00:10:16 user nova-compute[70709]: DEBUG nova.servicegroup.drivers.db [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=70709) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 28 00:10:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:10:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:11:06 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:11:07 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:11:07 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:11:07 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=10296MB free_disk=26.17379379272461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:11:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:11:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:11:07 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:11:07 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:11:07 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:11:07 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:11:07 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:11:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:12:07 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:12:08 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:12:08 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:12:08 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=10275MB free_disk=26.218841552734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:12:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:12:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:12:08 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:12:08 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:12:08 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:12:08 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:12:08 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:12:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:12:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:12:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:13:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:13:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:13:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:13:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:13:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:13:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:13:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:13:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:13:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:13:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:13:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:13:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:13:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:13:08 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:13:09 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:13:09 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:13:09 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=10279MB free_disk=25.99282455444336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:13:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:13:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:13:09 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:13:09 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:13:09 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:13:09 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:13:09 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:13:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:13:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:13:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:13:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:14:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:14:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:14:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:14:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:14:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:14:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:14:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:14:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:14:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:14:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:14:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:14:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:14:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:09 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:14:10 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:10 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:10 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=9528MB free_disk=26.015403747558594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:14:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:10 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:14:10 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:14:10 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:14:10 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:14:10 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:14:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:14:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:14:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "d007829f-9716-4aac-aaa5-e2c9becbe299" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:14:19 user nova-compute[70709]: INFO nova.compute.claims [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Claim successful on node user
Jul 28 00:14:19 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:14:19 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:14:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:14:19 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Creating image(s)
Jul 28 00:14:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "/opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "/opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "/opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025.part --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:20 user nova-compute[70709]: DEBUG nova.policy [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82c95ea8cd91475692bb9394d9d34e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef809cb1ad7477cb6cbeb995587a1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:14:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025.part --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:20 user nova-compute[70709]: DEBUG nova.virt.images [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] 51efbb04-1b4c-43c9-99e8-6467b05b27ad was qcow2, converting to raw {{(pid=70709) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 28 00:14:20 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:14:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025.part /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025.converted {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025.part /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025.converted" returned: 0 in 0.158s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025.converted --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025.converted --force-share --output=json" returned: 0 in 0.120s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.219s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:21 user nova-compute[70709]: INFO oslo.privsep.daemon [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdsimr_5o/privsep.sock']
Jul 28 00:14:21 user sudo[80193]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdsimr_5o/privsep.sock
Jul 28 00:14:21 user sudo[80193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 28 00:14:22 user sudo[80193]: pam_unix(sudo:session): session closed for user root
Jul 28 00:14:22 user nova-compute[70709]: INFO oslo.privsep.daemon [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Spawned new privsep daemon via rootwrap
Jul 28 00:14:22 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 28 00:14:22 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 28 00:14:22 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 28 00:14:22 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80196
Jul 28 00:14:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:22 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Successfully created port: 21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.127s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk 1073741824" returned: 0 in 0.051s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Cannot resize image /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lazy-loading 'migration_context' on Instance uuid d007829f-9716-4aac-aaa5-e2c9becbe299 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Ensure instance console log exists: /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:14:23 user nova-compute[70709]: INFO nova.compute.claims [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Claim successful on node user
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:14:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:14:24 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:14:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:14:24 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Creating image(s)
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "/opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "/opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "/opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.169s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG nova.policy [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '384ba52cf0bd4f03ac0dfc73cc81b31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce75e559c74038919f88f186e35a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.156s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk 1073741824" returned: 0 in 0.046s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.152s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Cannot resize image /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG nova.objects.instance [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'migration_context' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Ensure instance console log exists: /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "39bc08e9-7b3c-4698-921e-429823996ce1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "39bc08e9-7b3c-4698-921e-429823996ce1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:14:25 user nova-compute[70709]: INFO nova.compute.claims [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Claim successful on node user
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Successfully updated port: 21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "refresh_cache-d007829f-9716-4aac-aaa5-e2c9becbe299" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquired lock "refresh_cache-d007829f-9716-4aac-aaa5-e2c9becbe299" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.313s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:14:25 user nova-compute[70709]: INFO nova.compute.claims [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Claim successful on node user
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.network.neutron [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:14:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-b8908bf1-6660-40db-a5f2-119a3b02c5f1 req-712c9e7b-bbd3-44da-93e4-a5f4f8eae09a service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Received event network-changed-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-b8908bf1-6660-40db-a5f2-119a3b02c5f1 req-712c9e7b-bbd3-44da-93e4-a5f4f8eae09a service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Refreshing instance network info cache due to event network-changed-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b8908bf1-6660-40db-a5f2-119a3b02c5f1 req-712c9e7b-bbd3-44da-93e4-a5f4f8eae09a service nova] Acquiring lock "refresh_cache-d007829f-9716-4aac-aaa5-e2c9becbe299" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:14:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Creating image(s)
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "/opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "/opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "/opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.039s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.policy [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc9412c0c5a345399b7cc2ff4540535d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a7ed8f269b4e989727baa24619d774', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.166s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.658s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:14:26 user nova-compute[70709]: INFO nova.compute.claims [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Claim successful on node user
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:14:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk 1073741824" returned: 0 in 0.049s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:14:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Creating image(s)
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "/opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "/opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.policy [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c3a7c37bbe542008221fd2bcaf18f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7063760e8f3340f88a0505a3cdcdbf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Cannot resize image /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'migration_context' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Ensure instance console log exists: /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:14:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.123s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk 1073741824" returned: 0 in 0.053s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.network.neutron [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Successfully created port: ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:14:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Creating image(s)
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "/opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "/opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "/opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Cannot resize image /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.objects.instance [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'migration_context' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Ensure instance console log exists: /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Updating instance_info_cache with network_info: [{"id": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "address": "fa:16:3e:b6:d0:a1", "network": {"id": "04b1db21-ffaa-4b59-853c-c32f011c1e4a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431996065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eef809cb1ad7477cb6cbeb995587a1e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ac23ce-a2", "ovs_interfaceid": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Releasing lock "refresh_cache-d007829f-9716-4aac-aaa5-e2c9becbe299" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Instance network_info: |[{"id": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "address": "fa:16:3e:b6:d0:a1", "network": {"id": "04b1db21-ffaa-4b59-853c-c32f011c1e4a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431996065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eef809cb1ad7477cb6cbeb995587a1e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ac23ce-a2", "ovs_interfaceid": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b8908bf1-6660-40db-a5f2-119a3b02c5f1 req-712c9e7b-bbd3-44da-93e4-a5f4f8eae09a service nova] Acquired lock "refresh_cache-d007829f-9716-4aac-aaa5-e2c9becbe299" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.network.neutron [req-b8908bf1-6660-40db-a5f2-119a3b02c5f1 req-712c9e7b-bbd3-44da-93e4-a5f4f8eae09a service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Refreshing network info cache for port 21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Start _get_guest_xml network_info=[{"id": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "address": "fa:16:3e:b6:d0:a1", "network": {"id": "04b1db21-ffaa-4b59-853c-c32f011c1e4a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431996065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eef809cb1ad7477cb6cbeb995587a1e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ac23ce-a2", "ovs_interfaceid": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:14:26 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:26 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1262383189',display_name='tempest-DeleteServersTestJSON-server-1262383189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1262383189',id=1,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eef809cb1ad7477cb6cbeb995587a1e2',ramdisk_id='',reservation_id='r-ietafv9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-680948539',owner_user_name='tempest-DeleteServersTestJSON-680948539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:20Z,user_data=None,user_id='82c95ea8cd91475692bb9394d9d34e5d',uuid=d007829f-9716-4aac-aaa5-e2c9becbe299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "address": "fa:16:3e:b6:d0:a1", "network": {"id": "04b1db21-ffaa-4b59-853c-c32f011c1e4a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431996065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eef809cb1ad7477cb6cbeb995587a1e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ac23ce-a2", "ovs_interfaceid": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Converting VIF {"id": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "address": "fa:16:3e:b6:d0:a1", "network": {"id": "04b1db21-ffaa-4b59-853c-c32f011c1e4a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431996065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eef809cb1ad7477cb6cbeb995587a1e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ac23ce-a2", "ovs_interfaceid": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d0:a1,bridge_name='br-int',has_traffic_filtering=True,id=21ac23ce-a2fe-4bee-99a9-bba9bd8fd718,network=Network(04b1db21-ffaa-4b59-853c-c32f011c1e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ac23ce-a2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lazy-loading 'pci_devices' on Instance uuid d007829f-9716-4aac-aaa5-e2c9becbe299 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.165s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:14:27 user nova-compute[70709]:   <uuid>d007829f-9716-4aac-aaa5-e2c9becbe299</uuid>
Jul 28 00:14:27 user nova-compute[70709]:   <name>instance-00000001</name>
Jul 28 00:14:27 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:14:27 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:14:27 user nova-compute[70709]:   <metadata>
Jul 28 00:14:27 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:14:27 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:14:27 user nova-compute[70709]:       <nova:name>tempest-DeleteServersTestJSON-server-1262383189</nova:name>
Jul 28 00:14:27 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:14:26</nova:creationTime>
Jul 28 00:14:27 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:14:27 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:14:27 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:14:27 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:14:27 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:14:27 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:14:27 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:14:27 user nova-compute[70709]:       <nova:owner>
Jul 28 00:14:27 user nova-compute[70709]:         <nova:user uuid="82c95ea8cd91475692bb9394d9d34e5d">tempest-DeleteServersTestJSON-680948539-project-member</nova:user>
Jul 28 00:14:27 user nova-compute[70709]:         <nova:project uuid="eef809cb1ad7477cb6cbeb995587a1e2">tempest-DeleteServersTestJSON-680948539</nova:project>
Jul 28 00:14:27 user nova-compute[70709]:       </nova:owner>
Jul 28 00:14:27 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:14:27 user nova-compute[70709]:       <nova:ports>
Jul 28 00:14:27 user nova-compute[70709]:         <nova:port uuid="21ac23ce-a2fe-4bee-99a9-bba9bd8fd718">
Jul 28 00:14:27 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 28 00:14:27 user nova-compute[70709]:         </nova:port>
Jul 28 00:14:27 user nova-compute[70709]:       </nova:ports>
Jul 28 00:14:27 user nova-compute[70709]:     </nova:instance>
Jul 28 00:14:27 user nova-compute[70709]:   </metadata>
Jul 28 00:14:27 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:14:27 user nova-compute[70709]:     <system>
Jul 28 00:14:27 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:14:27 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:14:27 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:14:27 user nova-compute[70709]:       <entry name="serial">d007829f-9716-4aac-aaa5-e2c9becbe299</entry>
Jul 28 00:14:27 user nova-compute[70709]:       <entry name="uuid">d007829f-9716-4aac-aaa5-e2c9becbe299</entry>
Jul 28 00:14:27 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:14:27 user nova-compute[70709]:     </system>
Jul 28 00:14:27 user nova-compute[70709]:   </sysinfo>
Jul 28 00:14:27 user nova-compute[70709]:   <os>
Jul 28 00:14:27 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:14:27 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:14:27 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:14:27 user nova-compute[70709]:   </os>
Jul 28 00:14:27 user nova-compute[70709]:   <features>
Jul 28 00:14:27 user nova-compute[70709]:     <acpi/>
Jul 28 00:14:27 user nova-compute[70709]:     <apic/>
Jul 28 00:14:27 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:14:27 user nova-compute[70709]:   </features>
Jul 28 00:14:27 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:14:27 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:14:27 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:14:27 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:14:27 user nova-compute[70709]:   </clock>
Jul 28 00:14:27 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:14:27 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:14:27 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:14:27 user nova-compute[70709]:   </cpu>
Jul 28 00:14:27 user nova-compute[70709]:   <devices>
Jul 28 00:14:27 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:14:27 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:14:27 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk"/>
Jul 28 00:14:27 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:14:27 user nova-compute[70709]:     </disk>
Jul 28 00:14:27 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:14:27 user nova-compute[70709]:       <mac address="fa:16:3e:b6:d0:a1"/>
Jul 28 00:14:27 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:27 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:14:27 user nova-compute[70709]:       <target dev="tap21ac23ce-a2"/>
Jul 28 00:14:27 user nova-compute[70709]:     </interface>
Jul 28 00:14:27 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:14:27 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/console.log" append="off"/>
Jul 28 00:14:27 user nova-compute[70709]:     </serial>
Jul 28 00:14:27 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:14:27 user nova-compute[70709]:     <video>
Jul 28 00:14:27 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:27 user nova-compute[70709]:     </video>
Jul 28 00:14:27 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:14:27 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:14:27 user nova-compute[70709]:     </rng>
Jul 28 00:14:27 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:14:27 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:14:27 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:14:27 user nova-compute[70709]:     </memballoon>
Jul 28 00:14:27 user nova-compute[70709]:   </devices>
Jul 28 00:14:27 user nova-compute[70709]: </domain>
Jul 28 00:14:27 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1262383189',display_name='tempest-DeleteServersTestJSON-server-1262383189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1262383189',id=1,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eef809cb1ad7477cb6cbeb995587a1e2',ramdisk_id='',reservation_id='r-ietafv9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-680948539',owner_user_name='tempest-DeleteServersTestJSON-680948539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:20Z,user_data=None,user_id='82c95ea8cd91475692bb9394d9d34e5d',uuid=d007829f-9716-4aac-aaa5-e2c9becbe299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "address": "fa:16:3e:b6:d0:a1", "network": {"id": "04b1db21-ffaa-4b59-853c-c32f011c1e4a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431996065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eef809cb1ad7477cb6cbeb995587a1e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ac23ce-a2", "ovs_interfaceid": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Converting VIF {"id": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "address": "fa:16:3e:b6:d0:a1", "network": {"id": "04b1db21-ffaa-4b59-853c-c32f011c1e4a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431996065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eef809cb1ad7477cb6cbeb995587a1e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ac23ce-a2", "ovs_interfaceid": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d0:a1,bridge_name='br-int',has_traffic_filtering=True,id=21ac23ce-a2fe-4bee-99a9-bba9bd8fd718,network=Network(04b1db21-ffaa-4b59-853c-c32f011c1e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ac23ce-a2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG os_vif [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d0:a1,bridge_name='br-int',has_traffic_filtering=True,id=21ac23ce-a2fe-4bee-99a9-bba9bd8fd718,network=Network(04b1db21-ffaa-4b59-853c-c32f011c1e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ac23ce-a2') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.policy [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa22ce59fc4742d4ab16292a8b3d6e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6929fa5cb2284dd8b94c387bf6e3fef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Created schema index Interface.name {{(pid=70709) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Created schema index Port.name {{(pid=70709) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Created schema index Bridge.name {{(pid=70709) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk 1073741824" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [POLLOUT] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:14:27 user nova-compute[70709]: INFO oslo.privsep.daemon [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpjgcq2bom/privsep.sock']
Jul 28 00:14:27 user sudo[80284]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpjgcq2bom/privsep.sock
Jul 28 00:14:27 user sudo[80284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Cannot resize image /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'migration_context' on Instance uuid 39bc08e9-7b3c-4698-921e-429823996ce1 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Ensure instance console log exists: /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:14:27 user nova-compute[70709]: INFO nova.compute.claims [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Claim successful on node user
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.network.neutron [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:14:28 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:14:28 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Creating image(s)
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "/opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "/opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "/opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.policy [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8557f7232a94f76982b8840c534a6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05b559855734f9e9b221ec954881ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk 1073741824" returned: 0 in 0.049s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.network.neutron [req-b8908bf1-6660-40db-a5f2-119a3b02c5f1 req-712c9e7b-bbd3-44da-93e4-a5f4f8eae09a service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Updated VIF entry in instance network info cache for port 21ac23ce-a2fe-4bee-99a9-bba9bd8fd718. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.network.neutron [req-b8908bf1-6660-40db-a5f2-119a3b02c5f1 req-712c9e7b-bbd3-44da-93e4-a5f4f8eae09a service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Updating instance_info_cache with network_info: [{"id": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "address": "fa:16:3e:b6:d0:a1", "network": {"id": "04b1db21-ffaa-4b59-853c-c32f011c1e4a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431996065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eef809cb1ad7477cb6cbeb995587a1e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ac23ce-a2", "ovs_interfaceid": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b8908bf1-6660-40db-a5f2-119a3b02c5f1 req-712c9e7b-bbd3-44da-93e4-a5f4f8eae09a service nova] Releasing lock "refresh_cache-d007829f-9716-4aac-aaa5-e2c9becbe299" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.network.neutron [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Successfully created port: 7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Successfully created port: ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Cannot resize image /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.objects.instance [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'migration_context' on Instance uuid 25c6e8f8-d23d-4ec9-932b-df0471d3e41b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Ensure instance console log exists: /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:28 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Successfully created port: 42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:14:29 user sudo[80284]: pam_unix(sudo:session): session closed for user root
Jul 28 00:14:29 user nova-compute[70709]: INFO oslo.privsep.daemon [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Spawned new privsep daemon via rootwrap
Jul 28 00:14:29 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 28 00:14:29 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 28 00:14:29 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 28 00:14:29 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80305
Jul 28 00:14:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21ac23ce-a2, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21ac23ce-a2, col_values=(('external_ids', {'iface-id': '21ac23ce-a2fe-4bee-99a9-bba9bd8fd718', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:d0:a1', 'vm-uuid': 'd007829f-9716-4aac-aaa5-e2c9becbe299'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:14:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:29 user nova-compute[70709]: INFO os_vif [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d0:a1,bridge_name='br-int',has_traffic_filtering=True,id=21ac23ce-a2fe-4bee-99a9-bba9bd8fd718,network=Network(04b1db21-ffaa-4b59-853c-c32f011c1e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ac23ce-a2')
Jul 28 00:14:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:14:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] No VIF found with MAC fa:16:3e:b6:d0:a1, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:14:30 user nova-compute[70709]: DEBUG nova.network.neutron [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Successfully created port: 98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:14:30 user nova-compute[70709]: DEBUG nova.network.neutron [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Successfully updated port: ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:14:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquired lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:30 user nova-compute[70709]: DEBUG nova.network.neutron [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:14:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:14:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:30 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:14:30 user nova-compute[70709]: INFO nova.compute.claims [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Claim successful on node user
Jul 28 00:14:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.network.neutron [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-dec1022b-c68c-4aad-ba1e-3a46ad7d5f98 req-435dcdc7-b338-44f9-9557-158b7313de2c service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-changed-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-dec1022b-c68c-4aad-ba1e-3a46ad7d5f98 req-435dcdc7-b338-44f9-9557-158b7313de2c service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Refreshing instance network info cache due to event network-changed-ee9a657a-7c7d-4849-8394-9438487032f9. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dec1022b-c68c-4aad-ba1e-3a46ad7d5f98 req-435dcdc7-b338-44f9-9557-158b7313de2c service nova] Acquiring lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Successfully updated port: 42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquired lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:14:31 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-866b9c61-daba-4689-80e2-29f72a40f95e req-6dfb7472-67bc-486d-bf40-9e9c634ecd7d service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Received event network-changed-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-866b9c61-daba-4689-80e2-29f72a40f95e req-6dfb7472-67bc-486d-bf40-9e9c634ecd7d service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Refreshing instance network info cache due to event network-changed-42dd3fcb-611d-4f7f-ad9e-f3862e010c66. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-866b9c61-daba-4689-80e2-29f72a40f95e req-6dfb7472-67bc-486d-bf40-9e9c634ecd7d service nova] Acquiring lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:14:31 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Creating image(s)
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "/opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "/opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "/opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Successfully updated port: ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.policy [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4bdf96671af4dcd81161e222a396d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f49049f887a4601b9788b7929269749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquired lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-16d82fd2-3843-42a0-b18e-7c6a2173635c req-1c228480-c476-49fa-aaa8-d145832ac270 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-changed-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-16d82fd2-3843-42a0-b18e-7c6a2173635c req-1c228480-c476-49fa-aaa8-d145832ac270 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Refreshing instance network info cache due to event network-changed-ff3e21e0-da08-4f60-a9fb-e1a4ea572467. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-16d82fd2-3843-42a0-b18e-7c6a2173635c req-1c228480-c476-49fa-aaa8-d145832ac270 service nova] Acquiring lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.164s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk 1073741824" returned: 0 in 0.047s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Cannot resize image /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'migration_context' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Ensure instance console log exists: /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503272.5736856, d007829f-9716-4aac-aaa5-e2c9becbe299 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:32 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] VM Resumed (Lifecycle Event)
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:14:32 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Instance spawned successfully.
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.neutron [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updating instance_info_cache with network_info: [{"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Releasing lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Instance network_info: |[{"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dec1022b-c68c-4aad-ba1e-3a46ad7d5f98 req-435dcdc7-b338-44f9-9557-158b7313de2c service nova] Acquired lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.neutron [req-dec1022b-c68c-4aad-ba1e-3a46ad7d5f98 req-435dcdc7-b338-44f9-9557-158b7313de2c service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Refreshing network info cache for port ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Start _get_guest_xml network_info=[{"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:32 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:32 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1529008866',display_name='tempest-ServerActionsTestOtherA-server-1529008866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1529008866',id=2,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-ekq6qgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b61aaab4-ca86-41e6-a576-a7174d89a284,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.objects.instance [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'pci_devices' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:32 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503272.5766518, d007829f-9716-4aac-aaa5-e2c9becbe299 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:32 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] VM Started (Lifecycle Event)
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:14:32 user nova-compute[70709]:   <uuid>b61aaab4-ca86-41e6-a576-a7174d89a284</uuid>
Jul 28 00:14:32 user nova-compute[70709]:   <name>instance-00000002</name>
Jul 28 00:14:32 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:14:32 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:14:32 user nova-compute[70709]:   <metadata>
Jul 28 00:14:32 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:14:32 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:name>tempest-ServerActionsTestOtherA-server-1529008866</nova:name>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:14:32</nova:creationTime>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:14:32 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:14:32 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:owner>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:user uuid="384ba52cf0bd4f03ac0dfc73cc81b31d">tempest-ServerActionsTestOtherA-448184614-project-member</nova:user>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:project uuid="92ce75e559c74038919f88f186e35a17">tempest-ServerActionsTestOtherA-448184614</nova:project>
Jul 28 00:14:32 user nova-compute[70709]:       </nova:owner>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:ports>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:port uuid="ee9a657a-7c7d-4849-8394-9438487032f9">
Jul 28 00:14:32 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 28 00:14:32 user nova-compute[70709]:         </nova:port>
Jul 28 00:14:32 user nova-compute[70709]:       </nova:ports>
Jul 28 00:14:32 user nova-compute[70709]:     </nova:instance>
Jul 28 00:14:32 user nova-compute[70709]:   </metadata>
Jul 28 00:14:32 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:14:32 user nova-compute[70709]:     <system>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="serial">b61aaab4-ca86-41e6-a576-a7174d89a284</entry>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="uuid">b61aaab4-ca86-41e6-a576-a7174d89a284</entry>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:14:32 user nova-compute[70709]:     </system>
Jul 28 00:14:32 user nova-compute[70709]:   </sysinfo>
Jul 28 00:14:32 user nova-compute[70709]:   <os>
Jul 28 00:14:32 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:14:32 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:14:32 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:14:32 user nova-compute[70709]:   </os>
Jul 28 00:14:32 user nova-compute[70709]:   <features>
Jul 28 00:14:32 user nova-compute[70709]:     <acpi/>
Jul 28 00:14:32 user nova-compute[70709]:     <apic/>
Jul 28 00:14:32 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:14:32 user nova-compute[70709]:   </features>
Jul 28 00:14:32 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:14:32 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:14:32 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:14:32 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:14:32 user nova-compute[70709]:   </clock>
Jul 28 00:14:32 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:14:32 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:14:32 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:14:32 user nova-compute[70709]:   </cpu>
Jul 28 00:14:32 user nova-compute[70709]:   <devices>
Jul 28 00:14:32 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:14:32 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:14:32 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk"/>
Jul 28 00:14:32 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:14:32 user nova-compute[70709]:     </disk>
Jul 28 00:14:32 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:14:32 user nova-compute[70709]:       <mac address="fa:16:3e:4a:f3:cb"/>
Jul 28 00:14:32 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:32 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:14:32 user nova-compute[70709]:       <target dev="tapee9a657a-7c"/>
Jul 28 00:14:32 user nova-compute[70709]:     </interface>
Jul 28 00:14:32 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:14:32 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/console.log" append="off"/>
Jul 28 00:14:32 user nova-compute[70709]:     </serial>
Jul 28 00:14:32 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:14:32 user nova-compute[70709]:     <video>
Jul 28 00:14:32 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:32 user nova-compute[70709]:     </video>
Jul 28 00:14:32 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:14:32 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:14:32 user nova-compute[70709]:     </rng>
Jul 28 00:14:32 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:14:32 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:14:32 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:14:32 user nova-compute[70709]:     </memballoon>
Jul 28 00:14:32 user nova-compute[70709]:   </devices>
Jul 28 00:14:32 user nova-compute[70709]: </domain>
Jul 28 00:14:32 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1529008866',display_name='tempest-ServerActionsTestOtherA-server-1529008866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1529008866',id=2,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-ekq6qgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b61aaab4-ca86-41e6-a576-a7174d89a284,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG os_vif [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee9a657a-7c, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee9a657a-7c, col_values=(('external_ids', {'iface-id': 'ee9a657a-7c7d-4849-8394-9438487032f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:f3:cb', 'vm-uuid': 'b61aaab4-ca86-41e6-a576-a7174d89a284'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:32 user nova-compute[70709]: INFO nova.compute.manager [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Took 12.86 seconds to spawn the instance on the hypervisor.
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:14:32 user nova-compute[70709]: INFO os_vif [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c')
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:32 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updating instance_info_cache with network_info: [{"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Releasing lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Instance network_info: |[{"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-866b9c61-daba-4689-80e2-29f72a40f95e req-6dfb7472-67bc-486d-bf40-9e9c634ecd7d service nova] Acquired lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.neutron [req-866b9c61-daba-4689-80e2-29f72a40f95e req-6dfb7472-67bc-486d-bf40-9e9c634ecd7d service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Refreshing network info cache for port 42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Start _get_guest_xml network_info=[{"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No VIF found with MAC fa:16:3e:4a:f3:cb, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:14:32 user nova-compute[70709]: INFO nova.compute.manager [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Took 13.85 seconds to build instance.
Jul 28 00:14:32 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:32 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-280297558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-280297558',id=5,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-19x73pet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:27Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=39bc08e9-7b3c-4698-921e-429823996ce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=42dd3fcb-611d-4f7f-ad9e-f3862e010c66,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42dd3fcb-61') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'pci_devices' on Instance uuid 39bc08e9-7b3c-4698-921e-429823996ce1 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9f205d01-202d-4e93-ad04-78a6636ae44d tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.088s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:14:32 user nova-compute[70709]:   <uuid>39bc08e9-7b3c-4698-921e-429823996ce1</uuid>
Jul 28 00:14:32 user nova-compute[70709]:   <name>instance-00000005</name>
Jul 28 00:14:32 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:14:32 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:14:32 user nova-compute[70709]:   <metadata>
Jul 28 00:14:32 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:14:32 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-280297558</nova:name>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:14:32</nova:creationTime>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:14:32 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:14:32 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:owner>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:user uuid="fa22ce59fc4742d4ab16292a8b3d6e3f">tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member</nova:user>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:project uuid="6929fa5cb2284dd8b94c387bf6e3fef6">tempest-ServerBootFromVolumeStableRescueTest-2075329923</nova:project>
Jul 28 00:14:32 user nova-compute[70709]:       </nova:owner>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:14:32 user nova-compute[70709]:       <nova:ports>
Jul 28 00:14:32 user nova-compute[70709]:         <nova:port uuid="42dd3fcb-611d-4f7f-ad9e-f3862e010c66">
Jul 28 00:14:32 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 28 00:14:32 user nova-compute[70709]:         </nova:port>
Jul 28 00:14:32 user nova-compute[70709]:       </nova:ports>
Jul 28 00:14:32 user nova-compute[70709]:     </nova:instance>
Jul 28 00:14:32 user nova-compute[70709]:   </metadata>
Jul 28 00:14:32 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:14:32 user nova-compute[70709]:     <system>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="serial">39bc08e9-7b3c-4698-921e-429823996ce1</entry>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="uuid">39bc08e9-7b3c-4698-921e-429823996ce1</entry>
Jul 28 00:14:32 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:14:32 user nova-compute[70709]:     </system>
Jul 28 00:14:32 user nova-compute[70709]:   </sysinfo>
Jul 28 00:14:32 user nova-compute[70709]:   <os>
Jul 28 00:14:32 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:14:32 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:14:32 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:14:32 user nova-compute[70709]:   </os>
Jul 28 00:14:32 user nova-compute[70709]:   <features>
Jul 28 00:14:32 user nova-compute[70709]:     <acpi/>
Jul 28 00:14:32 user nova-compute[70709]:     <apic/>
Jul 28 00:14:32 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:14:32 user nova-compute[70709]:   </features>
Jul 28 00:14:32 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:14:32 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:14:32 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:14:32 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:14:32 user nova-compute[70709]:   </clock>
Jul 28 00:14:32 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:14:32 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:14:32 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:14:32 user nova-compute[70709]:   </cpu>
Jul 28 00:14:32 user nova-compute[70709]:   <devices>
Jul 28 00:14:32 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:14:32 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:14:32 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk"/>
Jul 28 00:14:32 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:14:32 user nova-compute[70709]:     </disk>
Jul 28 00:14:32 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:14:32 user nova-compute[70709]:       <mac address="fa:16:3e:92:f2:43"/>
Jul 28 00:14:32 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:32 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:14:32 user nova-compute[70709]:       <target dev="tap42dd3fcb-61"/>
Jul 28 00:14:32 user nova-compute[70709]:     </interface>
Jul 28 00:14:32 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:14:32 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/console.log" append="off"/>
Jul 28 00:14:32 user nova-compute[70709]:     </serial>
Jul 28 00:14:32 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:14:32 user nova-compute[70709]:     <video>
Jul 28 00:14:32 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:32 user nova-compute[70709]:     </video>
Jul 28 00:14:32 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:14:32 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:14:32 user nova-compute[70709]:     </rng>
Jul 28 00:14:32 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:14:32 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:14:32 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:14:32 user nova-compute[70709]:     </memballoon>
Jul 28 00:14:32 user nova-compute[70709]:   </devices>
Jul 28 00:14:32 user nova-compute[70709]: </domain>
Jul 28 00:14:32 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-280297558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-280297558',id=5,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-19x73pet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:27Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=39bc08e9-7b3c-4698-921e-429823996ce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=42dd3fcb-611d-4f7f-ad9e-f3862e010c66,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42dd3fcb-61') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG os_vif [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=42dd3fcb-611d-4f7f-ad9e-f3862e010c66,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42dd3fcb-61') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42dd3fcb-61, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42dd3fcb-61, col_values=(('external_ids', {'iface-id': '42dd3fcb-611d-4f7f-ad9e-f3862e010c66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:f2:43', 'vm-uuid': '39bc08e9-7b3c-4698-921e-429823996ce1'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:33 user nova-compute[70709]: INFO os_vif [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=42dd3fcb-611d-4f7f-ad9e-f3862e010c66,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42dd3fcb-61')
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No VIF found with MAC fa:16:3e:92:f2:43, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Successfully updated port: 7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquired lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-84309034-f7b8-4772-9160-20de3133abaf req-9500d0b5-fc23-4923-9461-8c46431c37de service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-changed-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-84309034-f7b8-4772-9160-20de3133abaf req-9500d0b5-fc23-4923-9461-8c46431c37de service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Refreshing instance network info cache due to event network-changed-7e92340f-f93d-411f-8e69-2a75164b3679. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-84309034-f7b8-4772-9160-20de3133abaf req-9500d0b5-fc23-4923-9461-8c46431c37de service nova] Acquiring lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updating instance_info_cache with network_info: [{"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Releasing lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance network_info: |[{"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-16d82fd2-3843-42a0-b18e-7c6a2173635c req-1c228480-c476-49fa-aaa8-d145832ac270 service nova] Acquired lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.neutron [req-16d82fd2-3843-42a0-b18e-7c6a2173635c req-1c228480-c476-49fa-aaa8-d145832ac270 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Refreshing network info cache for port ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Start _get_guest_xml network_info=[{"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Successfully updated port: 98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:14:33 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:33 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "refresh_cache-25c6e8f8-d23d-4ec9-932b-df0471d3e41b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquired lock "refresh_cache-25c6e8f8-d23d-4ec9-932b-df0471d3e41b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2037149563',display_name='tempest-AttachVolumeTestJSON-server-2037149563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2037149563',id=4,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKNEuPphQPlRnxY0JBcdikh9eshk4/9r69y1/MqVTQrHKGifhAnKKVbTQ0Mknn4VbSSaaRD/uIrFnnbFbmKZbFAB4vCxq+B8edPPxFALUWCcXG/5W4U5PVq8d2KDtyakA==',key_name='tempest-keypair-1576770531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-2xusewnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=2bb828f4-bb7d-4754-bcaa-38f2954b8eee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.objects.instance [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:14:33 user nova-compute[70709]:   <uuid>2bb828f4-bb7d-4754-bcaa-38f2954b8eee</uuid>
Jul 28 00:14:33 user nova-compute[70709]:   <name>instance-00000004</name>
Jul 28 00:14:33 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:14:33 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:14:33 user nova-compute[70709]:   <metadata>
Jul 28 00:14:33 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:14:33 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:14:33 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeTestJSON-server-2037149563</nova:name>
Jul 28 00:14:33 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:14:33</nova:creationTime>
Jul 28 00:14:33 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:14:33 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:14:33 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:14:33 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:14:33 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:14:33 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:14:33 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:14:33 user nova-compute[70709]:       <nova:owner>
Jul 28 00:14:33 user nova-compute[70709]:         <nova:user uuid="9c3a7c37bbe542008221fd2bcaf18f5c">tempest-AttachVolumeTestJSON-693253624-project-member</nova:user>
Jul 28 00:14:33 user nova-compute[70709]:         <nova:project uuid="7063760e8f3340f88a0505a3cdcdbf7c">tempest-AttachVolumeTestJSON-693253624</nova:project>
Jul 28 00:14:33 user nova-compute[70709]:       </nova:owner>
Jul 28 00:14:33 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:14:33 user nova-compute[70709]:       <nova:ports>
Jul 28 00:14:33 user nova-compute[70709]:         <nova:port uuid="ff3e21e0-da08-4f60-a9fb-e1a4ea572467">
Jul 28 00:14:33 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 28 00:14:33 user nova-compute[70709]:         </nova:port>
Jul 28 00:14:33 user nova-compute[70709]:       </nova:ports>
Jul 28 00:14:33 user nova-compute[70709]:     </nova:instance>
Jul 28 00:14:33 user nova-compute[70709]:   </metadata>
Jul 28 00:14:33 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:14:33 user nova-compute[70709]:     <system>
Jul 28 00:14:33 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:14:33 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:14:33 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:14:33 user nova-compute[70709]:       <entry name="serial">2bb828f4-bb7d-4754-bcaa-38f2954b8eee</entry>
Jul 28 00:14:33 user nova-compute[70709]:       <entry name="uuid">2bb828f4-bb7d-4754-bcaa-38f2954b8eee</entry>
Jul 28 00:14:33 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:14:33 user nova-compute[70709]:     </system>
Jul 28 00:14:33 user nova-compute[70709]:   </sysinfo>
Jul 28 00:14:33 user nova-compute[70709]:   <os>
Jul 28 00:14:33 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:14:33 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:14:33 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:14:33 user nova-compute[70709]:   </os>
Jul 28 00:14:33 user nova-compute[70709]:   <features>
Jul 28 00:14:33 user nova-compute[70709]:     <acpi/>
Jul 28 00:14:33 user nova-compute[70709]:     <apic/>
Jul 28 00:14:33 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:14:33 user nova-compute[70709]:   </features>
Jul 28 00:14:33 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:14:33 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:14:33 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:14:33 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:14:33 user nova-compute[70709]:   </clock>
Jul 28 00:14:33 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:14:33 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:14:33 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:14:33 user nova-compute[70709]:   </cpu>
Jul 28 00:14:33 user nova-compute[70709]:   <devices>
Jul 28 00:14:33 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:14:33 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:14:33 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk"/>
Jul 28 00:14:33 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:14:33 user nova-compute[70709]:     </disk>
Jul 28 00:14:33 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:14:33 user nova-compute[70709]:       <mac address="fa:16:3e:65:2d:ef"/>
Jul 28 00:14:33 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:33 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:14:33 user nova-compute[70709]:       <target dev="tapff3e21e0-da"/>
Jul 28 00:14:33 user nova-compute[70709]:     </interface>
Jul 28 00:14:33 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:14:33 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/console.log" append="off"/>
Jul 28 00:14:33 user nova-compute[70709]:     </serial>
Jul 28 00:14:33 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:14:33 user nova-compute[70709]:     <video>
Jul 28 00:14:33 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:33 user nova-compute[70709]:     </video>
Jul 28 00:14:33 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:14:33 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:14:33 user nova-compute[70709]:     </rng>
Jul 28 00:14:33 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:14:33 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:14:33 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:14:33 user nova-compute[70709]:     </memballoon>
Jul 28 00:14:33 user nova-compute[70709]:   </devices>
Jul 28 00:14:33 user nova-compute[70709]: </domain>
Jul 28 00:14:33 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2037149563',display_name='tempest-AttachVolumeTestJSON-server-2037149563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2037149563',id=4,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKNEuPphQPlRnxY0JBcdikh9eshk4/9r69y1/MqVTQrHKGifhAnKKVbTQ0Mknn4VbSSaaRD/uIrFnnbFbmKZbFAB4vCxq+B8edPPxFALUWCcXG/5W4U5PVq8d2KDtyakA==',key_name='tempest-keypair-1576770531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-2xusewnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=2bb828f4-bb7d-4754-bcaa-38f2954b8eee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG os_vif [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff3e21e0-da, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff3e21e0-da, col_values=(('external_ids', {'iface-id': 'ff3e21e0-da08-4f60-a9fb-e1a4ea572467', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:2d:ef', 'vm-uuid': '2bb828f4-bb7d-4754-bcaa-38f2954b8eee'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:33 user nova-compute[70709]: INFO os_vif [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da')
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No VIF found with MAC fa:16:3e:65:2d:ef, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Received event network-vif-plugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] Acquiring lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] No waiting events found dispatching network-vif-plugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:33 user nova-compute[70709]: WARNING nova.compute.manager [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Received unexpected event network-vif-plugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 for instance with vm_state active and task_state None.
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Received event network-vif-plugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] Acquiring lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] No waiting events found dispatching network-vif-plugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:33 user nova-compute[70709]: WARNING nova.compute.manager [req-bf08dbb9-25b8-47a5-8840-ff14b094bc4d req-056d5032-b1ae-4cff-80a1-4d2c3dc38ca4 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Received unexpected event network-vif-plugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 for instance with vm_state active and task_state None.
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-a8d28702-15ed-41ae-9fe0-56f64b234265 req-1f31ed9f-9ef3-4d60-be7d-fd19a1927ac1 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Received event network-changed-98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-a8d28702-15ed-41ae-9fe0-56f64b234265 req-1f31ed9f-9ef3-4d60-be7d-fd19a1927ac1 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Refreshing instance network info cache due to event network-changed-98291a12-0469-487a-8016-155a23415be0. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:14:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8d28702-15ed-41ae-9fe0-56f64b234265 req-1f31ed9f-9ef3-4d60-be7d-fd19a1927ac1 service nova] Acquiring lock "refresh_cache-25c6e8f8-d23d-4ec9-932b-df0471d3e41b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.network.neutron [req-866b9c61-daba-4689-80e2-29f72a40f95e req-6dfb7472-67bc-486d-bf40-9e9c634ecd7d service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updated VIF entry in instance network info cache for port 42dd3fcb-611d-4f7f-ad9e-f3862e010c66. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.network.neutron [req-866b9c61-daba-4689-80e2-29f72a40f95e req-6dfb7472-67bc-486d-bf40-9e9c634ecd7d service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updating instance_info_cache with network_info: [{"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-866b9c61-daba-4689-80e2-29f72a40f95e req-6dfb7472-67bc-486d-bf40-9e9c634ecd7d service nova] Releasing lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.network.neutron [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Updating instance_info_cache with network_info: [{"id": "98291a12-0469-487a-8016-155a23415be0", "address": "fa:16:3e:d5:5f:d5", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98291a12-04", "ovs_interfaceid": "98291a12-0469-487a-8016-155a23415be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Releasing lock "refresh_cache-25c6e8f8-d23d-4ec9-932b-df0471d3e41b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Instance network_info: |[{"id": "98291a12-0469-487a-8016-155a23415be0", "address": "fa:16:3e:d5:5f:d5", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98291a12-04", "ovs_interfaceid": "98291a12-0469-487a-8016-155a23415be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8d28702-15ed-41ae-9fe0-56f64b234265 req-1f31ed9f-9ef3-4d60-be7d-fd19a1927ac1 service nova] Acquired lock "refresh_cache-25c6e8f8-d23d-4ec9-932b-df0471d3e41b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.network.neutron [req-a8d28702-15ed-41ae-9fe0-56f64b234265 req-1f31ed9f-9ef3-4d60-be7d-fd19a1927ac1 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Refreshing network info cache for port 98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Start _get_guest_xml network_info=[{"id": "98291a12-0469-487a-8016-155a23415be0", "address": "fa:16:3e:d5:5f:d5", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98291a12-04", "ovs_interfaceid": "98291a12-0469-487a-8016-155a23415be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:14:34 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:34 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1244498967',display_name='tempest-AttachVolumeNegativeTest-server-1244498967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1244498967',id=6,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItfbsS9v9Q1EeY/KlrE8uwiS51IntHw9BgxttLdGuVPv+h/RK7t+qUZDd/g1FTG02L+NVWBFUwAA2d7QA8d6NWX3RJnG26WJ5Kkj/TtPwNLCCKgijc1C8TqA8YaYTcdtg==',key_name='tempest-keypair-1094487479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-ptepngd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=25c6e8f8-d23d-4ec9-932b-df0471d3e41b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98291a12-0469-487a-8016-155a23415be0", "address": "fa:16:3e:d5:5f:d5", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98291a12-04", "ovs_interfaceid": "98291a12-0469-487a-8016-155a23415be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "98291a12-0469-487a-8016-155a23415be0", "address": "fa:16:3e:d5:5f:d5", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98291a12-04", "ovs_interfaceid": "98291a12-0469-487a-8016-155a23415be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=98291a12-0469-487a-8016-155a23415be0,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98291a12-04') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.objects.instance [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'pci_devices' on Instance uuid 25c6e8f8-d23d-4ec9-932b-df0471d3e41b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:14:34 user nova-compute[70709]:   <uuid>25c6e8f8-d23d-4ec9-932b-df0471d3e41b</uuid>
Jul 28 00:14:34 user nova-compute[70709]:   <name>instance-00000006</name>
Jul 28 00:14:34 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:14:34 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:14:34 user nova-compute[70709]:   <metadata>
Jul 28 00:14:34 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:14:34 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:14:34 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1244498967</nova:name>
Jul 28 00:14:34 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:14:34</nova:creationTime>
Jul 28 00:14:34 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:14:34 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:14:34 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:14:34 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:14:34 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:14:34 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:14:34 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:14:34 user nova-compute[70709]:       <nova:owner>
Jul 28 00:14:34 user nova-compute[70709]:         <nova:user uuid="d8557f7232a94f76982b8840c534a6d4">tempest-AttachVolumeNegativeTest-337281402-project-member</nova:user>
Jul 28 00:14:34 user nova-compute[70709]:         <nova:project uuid="e05b559855734f9e9b221ec954881ccd">tempest-AttachVolumeNegativeTest-337281402</nova:project>
Jul 28 00:14:34 user nova-compute[70709]:       </nova:owner>
Jul 28 00:14:34 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:14:34 user nova-compute[70709]:       <nova:ports>
Jul 28 00:14:34 user nova-compute[70709]:         <nova:port uuid="98291a12-0469-487a-8016-155a23415be0">
Jul 28 00:14:34 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 28 00:14:34 user nova-compute[70709]:         </nova:port>
Jul 28 00:14:34 user nova-compute[70709]:       </nova:ports>
Jul 28 00:14:34 user nova-compute[70709]:     </nova:instance>
Jul 28 00:14:34 user nova-compute[70709]:   </metadata>
Jul 28 00:14:34 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:14:34 user nova-compute[70709]:     <system>
Jul 28 00:14:34 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:14:34 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:14:34 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:14:34 user nova-compute[70709]:       <entry name="serial">25c6e8f8-d23d-4ec9-932b-df0471d3e41b</entry>
Jul 28 00:14:34 user nova-compute[70709]:       <entry name="uuid">25c6e8f8-d23d-4ec9-932b-df0471d3e41b</entry>
Jul 28 00:14:34 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:14:34 user nova-compute[70709]:     </system>
Jul 28 00:14:34 user nova-compute[70709]:   </sysinfo>
Jul 28 00:14:34 user nova-compute[70709]:   <os>
Jul 28 00:14:34 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:14:34 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:14:34 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:14:34 user nova-compute[70709]:   </os>
Jul 28 00:14:34 user nova-compute[70709]:   <features>
Jul 28 00:14:34 user nova-compute[70709]:     <acpi/>
Jul 28 00:14:34 user nova-compute[70709]:     <apic/>
Jul 28 00:14:34 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:14:34 user nova-compute[70709]:   </features>
Jul 28 00:14:34 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:14:34 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:14:34 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:14:34 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:14:34 user nova-compute[70709]:   </clock>
Jul 28 00:14:34 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:14:34 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:14:34 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:14:34 user nova-compute[70709]:   </cpu>
Jul 28 00:14:34 user nova-compute[70709]:   <devices>
Jul 28 00:14:34 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:14:34 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:14:34 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk"/>
Jul 28 00:14:34 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:14:34 user nova-compute[70709]:     </disk>
Jul 28 00:14:34 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:14:34 user nova-compute[70709]:       <mac address="fa:16:3e:d5:5f:d5"/>
Jul 28 00:14:34 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:34 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:14:34 user nova-compute[70709]:       <target dev="tap98291a12-04"/>
Jul 28 00:14:34 user nova-compute[70709]:     </interface>
Jul 28 00:14:34 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:14:34 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/console.log" append="off"/>
Jul 28 00:14:34 user nova-compute[70709]:     </serial>
Jul 28 00:14:34 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:14:34 user nova-compute[70709]:     <video>
Jul 28 00:14:34 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:34 user nova-compute[70709]:     </video>
Jul 28 00:14:34 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:14:34 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:14:34 user nova-compute[70709]:     </rng>
Jul 28 00:14:34 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:14:34 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:14:34 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:14:34 user nova-compute[70709]:     </memballoon>
Jul 28 00:14:34 user nova-compute[70709]:   </devices>
Jul 28 00:14:34 user nova-compute[70709]: </domain>
Jul 28 00:14:34 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1244498967',display_name='tempest-AttachVolumeNegativeTest-server-1244498967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1244498967',id=6,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItfbsS9v9Q1EeY/KlrE8uwiS51IntHw9BgxttLdGuVPv+h/RK7t+qUZDd/g1FTG02L+NVWBFUwAA2d7QA8d6NWX3RJnG26WJ5Kkj/TtPwNLCCKgijc1C8TqA8YaYTcdtg==',key_name='tempest-keypair-1094487479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-ptepngd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=25c6e8f8-d23d-4ec9-932b-df0471d3e41b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98291a12-0469-487a-8016-155a23415be0", "address": "fa:16:3e:d5:5f:d5", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98291a12-04", "ovs_interfaceid": "98291a12-0469-487a-8016-155a23415be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "98291a12-0469-487a-8016-155a23415be0", "address": "fa:16:3e:d5:5f:d5", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98291a12-04", "ovs_interfaceid": "98291a12-0469-487a-8016-155a23415be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=98291a12-0469-487a-8016-155a23415be0,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98291a12-04') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG os_vif [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=98291a12-0469-487a-8016-155a23415be0,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98291a12-04') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98291a12-04, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98291a12-04, col_values=(('external_ids', {'iface-id': '98291a12-0469-487a-8016-155a23415be0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:5f:d5', 'vm-uuid': '25c6e8f8-d23d-4ec9-932b-df0471d3e41b'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Successfully created port: 84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:34 user nova-compute[70709]: INFO os_vif [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=98291a12-0469-487a-8016-155a23415be0,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98291a12-04')
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:14:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No VIF found with MAC fa:16:3e:d5:5f:d5, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.neutron [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating instance_info_cache with network_info: [{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.neutron [req-16d82fd2-3843-42a0-b18e-7c6a2173635c req-1c228480-c476-49fa-aaa8-d145832ac270 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updated VIF entry in instance network info cache for port ff3e21e0-da08-4f60-a9fb-e1a4ea572467. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.neutron [req-16d82fd2-3843-42a0-b18e-7c6a2173635c req-1c228480-c476-49fa-aaa8-d145832ac270 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updating instance_info_cache with network_info: [{"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Releasing lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance network_info: |[{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-84309034-f7b8-4772-9160-20de3133abaf req-9500d0b5-fc23-4923-9461-8c46431c37de service nova] Acquired lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.neutron [req-84309034-f7b8-4772-9160-20de3133abaf req-9500d0b5-fc23-4923-9461-8c46431c37de service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Refreshing network info cache for port 7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Start _get_guest_xml network_info=[{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-16d82fd2-3843-42a0-b18e-7c6a2173635c req-1c228480-c476-49fa-aaa8-d145832ac270 service nova] Releasing lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:35 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:35 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1488928010',display_name='tempest-ServerActionsTestOtherB-server-1488928010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1488928010',id=3,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnNPKIDRaM81k628x28KRrACS+k9io0IYMr8rKnbfV6R9PEGedJ0uPueig7JixSq/MVd5cruSs8PGo9MLWndddj6j9yk5HzD1hsNyADvhHRJFhgOMMfk3L2UUGGtvzDbA==',key_name='tempest-keypair-458737518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8a7ed8f269b4e989727baa24619d774',ramdisk_id='',reservation_id='r-0vm06iql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1900188209',owner_user_name='tempest-ServerActionsTestOtherB-1900188209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc9412c0c5a345399b7cc2ff4540535d',uuid=df55bbd3-31ab-42f8-9a71-4ed8e3c4428c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converting VIF {"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'pci_devices' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:14:35 user nova-compute[70709]:   <uuid>df55bbd3-31ab-42f8-9a71-4ed8e3c4428c</uuid>
Jul 28 00:14:35 user nova-compute[70709]:   <name>instance-00000003</name>
Jul 28 00:14:35 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:14:35 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:14:35 user nova-compute[70709]:   <metadata>
Jul 28 00:14:35 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:14:35 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:14:35 user nova-compute[70709]:       <nova:name>tempest-ServerActionsTestOtherB-server-1488928010</nova:name>
Jul 28 00:14:35 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:14:35</nova:creationTime>
Jul 28 00:14:35 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:14:35 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:14:35 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:14:35 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:14:35 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:14:35 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:14:35 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:14:35 user nova-compute[70709]:       <nova:owner>
Jul 28 00:14:35 user nova-compute[70709]:         <nova:user uuid="fc9412c0c5a345399b7cc2ff4540535d">tempest-ServerActionsTestOtherB-1900188209-project-member</nova:user>
Jul 28 00:14:35 user nova-compute[70709]:         <nova:project uuid="c8a7ed8f269b4e989727baa24619d774">tempest-ServerActionsTestOtherB-1900188209</nova:project>
Jul 28 00:14:35 user nova-compute[70709]:       </nova:owner>
Jul 28 00:14:35 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:14:35 user nova-compute[70709]:       <nova:ports>
Jul 28 00:14:35 user nova-compute[70709]:         <nova:port uuid="7e92340f-f93d-411f-8e69-2a75164b3679">
Jul 28 00:14:35 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 28 00:14:35 user nova-compute[70709]:         </nova:port>
Jul 28 00:14:35 user nova-compute[70709]:       </nova:ports>
Jul 28 00:14:35 user nova-compute[70709]:     </nova:instance>
Jul 28 00:14:35 user nova-compute[70709]:   </metadata>
Jul 28 00:14:35 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:14:35 user nova-compute[70709]:     <system>
Jul 28 00:14:35 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:14:35 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:14:35 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:14:35 user nova-compute[70709]:       <entry name="serial">df55bbd3-31ab-42f8-9a71-4ed8e3c4428c</entry>
Jul 28 00:14:35 user nova-compute[70709]:       <entry name="uuid">df55bbd3-31ab-42f8-9a71-4ed8e3c4428c</entry>
Jul 28 00:14:35 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:14:35 user nova-compute[70709]:     </system>
Jul 28 00:14:35 user nova-compute[70709]:   </sysinfo>
Jul 28 00:14:35 user nova-compute[70709]:   <os>
Jul 28 00:14:35 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:14:35 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:14:35 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:14:35 user nova-compute[70709]:   </os>
Jul 28 00:14:35 user nova-compute[70709]:   <features>
Jul 28 00:14:35 user nova-compute[70709]:     <acpi/>
Jul 28 00:14:35 user nova-compute[70709]:     <apic/>
Jul 28 00:14:35 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:14:35 user nova-compute[70709]:   </features>
Jul 28 00:14:35 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:14:35 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:14:35 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:14:35 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:14:35 user nova-compute[70709]:   </clock>
Jul 28 00:14:35 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:14:35 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:14:35 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:14:35 user nova-compute[70709]:   </cpu>
Jul 28 00:14:35 user nova-compute[70709]:   <devices>
Jul 28 00:14:35 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:14:35 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:14:35 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk"/>
Jul 28 00:14:35 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:14:35 user nova-compute[70709]:     </disk>
Jul 28 00:14:35 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:14:35 user nova-compute[70709]:       <mac address="fa:16:3e:58:0f:bc"/>
Jul 28 00:14:35 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:35 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:14:35 user nova-compute[70709]:       <target dev="tap7e92340f-f9"/>
Jul 28 00:14:35 user nova-compute[70709]:     </interface>
Jul 28 00:14:35 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:14:35 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/console.log" append="off"/>
Jul 28 00:14:35 user nova-compute[70709]:     </serial>
Jul 28 00:14:35 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:14:35 user nova-compute[70709]:     <video>
Jul 28 00:14:35 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:35 user nova-compute[70709]:     </video>
Jul 28 00:14:35 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:14:35 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:14:35 user nova-compute[70709]:     </rng>
Jul 28 00:14:35 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:14:35 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:14:35 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:14:35 user nova-compute[70709]:     </memballoon>
Jul 28 00:14:35 user nova-compute[70709]:   </devices>
Jul 28 00:14:35 user nova-compute[70709]: </domain>
Jul 28 00:14:35 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1488928010',display_name='tempest-ServerActionsTestOtherB-server-1488928010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1488928010',id=3,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnNPKIDRaM81k628x28KRrACS+k9io0IYMr8rKnbfV6R9PEGedJ0uPueig7JixSq/MVd5cruSs8PGo9MLWndddj6j9yk5HzD1hsNyADvhHRJFhgOMMfk3L2UUGGtvzDbA==',key_name='tempest-keypair-458737518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8a7ed8f269b4e989727baa24619d774',ramdisk_id='',reservation_id='r-0vm06iql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1900188209',owner_user_name='tempest-ServerActionsTestOtherB-1900188209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc9412c0c5a345399b7cc2ff4540535d',uuid=df55bbd3-31ab-42f8-9a71-4ed8e3c4428c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converting VIF {"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG os_vif [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e92340f-f9, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e92340f-f9, col_values=(('external_ids', {'iface-id': '7e92340f-f93d-411f-8e69-2a75164b3679', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:0f:bc', 'vm-uuid': 'df55bbd3-31ab-42f8-9a71-4ed8e3c4428c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:35 user nova-compute[70709]: INFO os_vif [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9')
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] No VIF found with MAC fa:16:3e:58:0f:bc, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.neutron [req-dec1022b-c68c-4aad-ba1e-3a46ad7d5f98 req-435dcdc7-b338-44f9-9557-158b7313de2c service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updated VIF entry in instance network info cache for port ee9a657a-7c7d-4849-8394-9438487032f9. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.neutron [req-dec1022b-c68c-4aad-ba1e-3a46ad7d5f98 req-435dcdc7-b338-44f9-9557-158b7313de2c service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updating instance_info_cache with network_info: [{"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dec1022b-c68c-4aad-ba1e-3a46ad7d5f98 req-435dcdc7-b338-44f9-9557-158b7313de2c service nova] Releasing lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.neutron [req-a8d28702-15ed-41ae-9fe0-56f64b234265 req-1f31ed9f-9ef3-4d60-be7d-fd19a1927ac1 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Updated VIF entry in instance network info cache for port 98291a12-0469-487a-8016-155a23415be0. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG nova.network.neutron [req-a8d28702-15ed-41ae-9fe0-56f64b234265 req-1f31ed9f-9ef3-4d60-be7d-fd19a1927ac1 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Updating instance_info_cache with network_info: [{"id": "98291a12-0469-487a-8016-155a23415be0", "address": "fa:16:3e:d5:5f:d5", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98291a12-04", "ovs_interfaceid": "98291a12-0469-487a-8016-155a23415be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8d28702-15ed-41ae-9fe0-56f64b234265 req-1f31ed9f-9ef3-4d60-be7d-fd19a1927ac1 service nova] Releasing lock "refresh_cache-25c6e8f8-d23d-4ec9-932b-df0471d3e41b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-84309034-f7b8-4772-9160-20de3133abaf req-9500d0b5-fc23-4923-9461-8c46431c37de service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updated VIF entry in instance network info cache for port 7e92340f-f93d-411f-8e69-2a75164b3679. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:14:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-84309034-f7b8-4772-9160-20de3133abaf req-9500d0b5-fc23-4923-9461-8c46431c37de service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating instance_info_cache with network_info: [{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-84309034-f7b8-4772-9160-20de3133abaf req-9500d0b5-fc23-4923-9461-8c46431c37de service nova] Releasing lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Successfully updated port: 84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquired lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-193769bd-c332-487a-8cba-5113549a52ff req-057c2fe6-0392-412f-8626-9aba14aaf739 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-changed-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-193769bd-c332-487a-8cba-5113549a52ff req-057c2fe6-0392-412f-8626-9aba14aaf739 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Refreshing instance network info cache due to event network-changed-84dc7a3e-6f63-4ff1-8689-38f607df3ae6. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-193769bd-c332-487a-8cba-5113549a52ff req-057c2fe6-0392-412f-8626-9aba14aaf739 service nova] Acquiring lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-1517198a-8f23-41c9-b93b-b3100ca976b4 req-39859bf3-b62d-42bb-bcb1-b446fd5bdecc service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1517198a-8f23-41c9-b93b-b3100ca976b4 req-39859bf3-b62d-42bb-bcb1-b446fd5bdecc service nova] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1517198a-8f23-41c9-b93b-b3100ca976b4 req-39859bf3-b62d-42bb-bcb1-b446fd5bdecc service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1517198a-8f23-41c9-b93b-b3100ca976b4 req-39859bf3-b62d-42bb-bcb1-b446fd5bdecc service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-1517198a-8f23-41c9-b93b-b3100ca976b4 req-39859bf3-b62d-42bb-bcb1-b446fd5bdecc service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] No waiting events found dispatching network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:38 user nova-compute[70709]: WARNING nova.compute.manager [req-1517198a-8f23-41c9-b93b-b3100ca976b4 req-39859bf3-b62d-42bb-bcb1-b446fd5bdecc service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received unexpected event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 for instance with vm_state building and task_state spawning.
Jul 28 00:14:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:14:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updating instance_info_cache with network_info: [{"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Releasing lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Instance network_info: |[{"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-193769bd-c332-487a-8cba-5113549a52ff req-057c2fe6-0392-412f-8626-9aba14aaf739 service nova] Acquired lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG nova.network.neutron [req-193769bd-c332-487a-8cba-5113549a52ff req-057c2fe6-0392-412f-8626-9aba14aaf739 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Refreshing network info cache for port 84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Start _get_guest_xml network_info=[{"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG nova.compute.manager [req-9da66fad-cf81-45fd-96a9-6e8e1a26ab6e req-b0534edb-05fb-428d-a74d-b654292adb4a service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9da66fad-cf81-45fd-96a9-6e8e1a26ab6e req-b0534edb-05fb-428d-a74d-b654292adb4a service nova] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9da66fad-cf81-45fd-96a9-6e8e1a26ab6e req-b0534edb-05fb-428d-a74d-b654292adb4a service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9da66fad-cf81-45fd-96a9-6e8e1a26ab6e req-b0534edb-05fb-428d-a74d-b654292adb4a service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG nova.compute.manager [req-9da66fad-cf81-45fd-96a9-6e8e1a26ab6e req-b0534edb-05fb-428d-a74d-b654292adb4a service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] No waiting events found dispatching network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:40 user nova-compute[70709]: WARNING nova.compute.manager [req-9da66fad-cf81-45fd-96a9-6e8e1a26ab6e req-b0534edb-05fb-428d-a74d-b654292adb4a service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received unexpected event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 for instance with vm_state building and task_state spawning.
Jul 28 00:14:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-193769bd-c332-487a-8cba-5113549a52ff req-057c2fe6-0392-412f-8626-9aba14aaf739 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updated VIF entry in instance network info cache for port 84dc7a3e-6f63-4ff1-8689-38f607df3ae6. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-193769bd-c332-487a-8cba-5113549a52ff req-057c2fe6-0392-412f-8626-9aba14aaf739 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updating instance_info_cache with network_info: [{"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-193769bd-c332-487a-8cba-5113549a52ff req-057c2fe6-0392-412f-8626-9aba14aaf739 service nova] Releasing lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-6f4aeed1-84f1-4f2f-8f66-aaf5f90db1fb req-b81129e2-9ea7-4949-a9ae-eb0aed8eba09 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6f4aeed1-84f1-4f2f-8f66-aaf5f90db1fb req-b81129e2-9ea7-4949-a9ae-eb0aed8eba09 service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6f4aeed1-84f1-4f2f-8f66-aaf5f90db1fb req-b81129e2-9ea7-4949-a9ae-eb0aed8eba09 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6f4aeed1-84f1-4f2f-8f66-aaf5f90db1fb req-b81129e2-9ea7-4949-a9ae-eb0aed8eba09 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-6f4aeed1-84f1-4f2f-8f66-aaf5f90db1fb req-b81129e2-9ea7-4949-a9ae-eb0aed8eba09 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:42 user nova-compute[70709]: WARNING nova.compute.manager [req-6f4aeed1-84f1-4f2f-8f66-aaf5f90db1fb req-b81129e2-9ea7-4949-a9ae-eb0aed8eba09 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received unexpected event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with vm_state building and task_state spawning.
Jul 28 00:14:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Received event network-vif-plugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] Acquiring lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] Lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] Lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] No waiting events found dispatching network-vif-plugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:42 user nova-compute[70709]: WARNING nova.compute.manager [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Received unexpected event network-vif-plugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 for instance with vm_state building and task_state spawning.
Jul 28 00:14:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Received event network-vif-plugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] Acquiring lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] Lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] Lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] No waiting events found dispatching network-vif-plugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:42 user nova-compute[70709]: WARNING nova.compute.manager [req-96c8b492-ae15-4029-be5a-018cc3e0ad97 req-968bd1ce-a206-4cb4-9685-1e3bfe803a05 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Received unexpected event network-vif-plugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 for instance with vm_state building and task_state spawning.
Jul 28 00:14:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-0d96d708-9ae2-483e-bff5-f51f4a26565f req-49313822-f15d-49c1-bbd6-81c96253b6d4 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Received event network-vif-plugged-98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0d96d708-9ae2-483e-bff5-f51f4a26565f req-49313822-f15d-49c1-bbd6-81c96253b6d4 service nova] Acquiring lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0d96d708-9ae2-483e-bff5-f51f4a26565f req-49313822-f15d-49c1-bbd6-81c96253b6d4 service nova] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0d96d708-9ae2-483e-bff5-f51f4a26565f req-49313822-f15d-49c1-bbd6-81c96253b6d4 service nova] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-0d96d708-9ae2-483e-bff5-f51f4a26565f req-49313822-f15d-49c1-bbd6-81c96253b6d4 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] No waiting events found dispatching network-vif-plugged-98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:43 user nova-compute[70709]: WARNING nova.compute.manager [req-0d96d708-9ae2-483e-bff5-f51f4a26565f req-49313822-f15d-49c1-bbd6-81c96253b6d4 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Received unexpected event network-vif-plugged-98291a12-0469-487a-8016-155a23415be0 for instance with vm_state building and task_state spawning.
Jul 28 00:14:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:44 user nova-compute[70709]: WARNING nova.compute.manager [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received unexpected event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with vm_state building and task_state spawning.
Jul 28 00:14:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:44 user nova-compute[70709]: WARNING nova.compute.manager [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received unexpected event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with vm_state building and task_state spawning.
Jul 28 00:14:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:44 user nova-compute[70709]: WARNING nova.compute.manager [req-d448d078-92b3-4c93-b902-b209941af6eb req-6ddb973c-f456-4bbc-b1aa-7ec5962dc498 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received unexpected event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with vm_state building and task_state spawning.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503285.0307019, 39bc08e9-7b3c-4698-921e-429823996ce1 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] VM Resumed (Lifecycle Event)
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Instance spawned successfully.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:14:45 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:45 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1549359080',display_name='tempest-ServerStableDeviceRescueTest-server-1549359080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1549359080',id=7,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwy4HneA3ZUmeqPHrbQse+qJUWEhfXTEMPBGDoaqxhrehEEkFn9HOsG11LJXknhyS0mntTrtVk8HXwWH6XqWK8W1vLqidE4n9cl+QqPNrxj8k61BRJMpjdt4hxKUVAzog==',key_name='tempest-keypair-154217269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f49049f887a4601b9788b7929269749',ramdisk_id='',reservation_id='r-cg2emlcr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-292119774',owner_user_name='tempest-ServerStableDeviceRescueTest-292119774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4bdf96671af4dcd81161e222a396d2e',uuid=a585b419-b9f5-4bd6-bbc9-cdfc4e732712,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Converting VIF {"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:3a:3b,bridge_name='br-int',has_traffic_filtering=True,id=84dc7a3e-6f63-4ff1-8689-38f607df3ae6,network=Network(de8b5a09-458a-445c-b0f7-21e454cb5d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc7a3e-6f') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'pci_devices' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Instance spawned successfully.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503285.0323522, 39bc08e9-7b3c-4698-921e-429823996ce1 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] VM Started (Lifecycle Event)
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:14:45 user nova-compute[70709]:   <uuid>a585b419-b9f5-4bd6-bbc9-cdfc4e732712</uuid>
Jul 28 00:14:45 user nova-compute[70709]:   <name>instance-00000007</name>
Jul 28 00:14:45 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:14:45 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:14:45 user nova-compute[70709]:   <metadata>
Jul 28 00:14:45 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:14:45 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:14:45 user nova-compute[70709]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1549359080</nova:name>
Jul 28 00:14:45 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:14:45</nova:creationTime>
Jul 28 00:14:45 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:14:45 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:14:45 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:14:45 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:14:45 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:14:45 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:14:45 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:14:45 user nova-compute[70709]:       <nova:owner>
Jul 28 00:14:45 user nova-compute[70709]:         <nova:user uuid="f4bdf96671af4dcd81161e222a396d2e">tempest-ServerStableDeviceRescueTest-292119774-project-member</nova:user>
Jul 28 00:14:45 user nova-compute[70709]:         <nova:project uuid="5f49049f887a4601b9788b7929269749">tempest-ServerStableDeviceRescueTest-292119774</nova:project>
Jul 28 00:14:45 user nova-compute[70709]:       </nova:owner>
Jul 28 00:14:45 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:14:45 user nova-compute[70709]:       <nova:ports>
Jul 28 00:14:45 user nova-compute[70709]:         <nova:port uuid="84dc7a3e-6f63-4ff1-8689-38f607df3ae6">
Jul 28 00:14:45 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 28 00:14:45 user nova-compute[70709]:         </nova:port>
Jul 28 00:14:45 user nova-compute[70709]:       </nova:ports>
Jul 28 00:14:45 user nova-compute[70709]:     </nova:instance>
Jul 28 00:14:45 user nova-compute[70709]:   </metadata>
Jul 28 00:14:45 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:14:45 user nova-compute[70709]:     <system>
Jul 28 00:14:45 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:14:45 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:14:45 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:14:45 user nova-compute[70709]:       <entry name="serial">a585b419-b9f5-4bd6-bbc9-cdfc4e732712</entry>
Jul 28 00:14:45 user nova-compute[70709]:       <entry name="uuid">a585b419-b9f5-4bd6-bbc9-cdfc4e732712</entry>
Jul 28 00:14:45 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:14:45 user nova-compute[70709]:     </system>
Jul 28 00:14:45 user nova-compute[70709]:   </sysinfo>
Jul 28 00:14:45 user nova-compute[70709]:   <os>
Jul 28 00:14:45 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:14:45 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:14:45 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:14:45 user nova-compute[70709]:   </os>
Jul 28 00:14:45 user nova-compute[70709]:   <features>
Jul 28 00:14:45 user nova-compute[70709]:     <acpi/>
Jul 28 00:14:45 user nova-compute[70709]:     <apic/>
Jul 28 00:14:45 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:14:45 user nova-compute[70709]:   </features>
Jul 28 00:14:45 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:14:45 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:14:45 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:14:45 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:14:45 user nova-compute[70709]:   </clock>
Jul 28 00:14:45 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:14:45 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:14:45 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:14:45 user nova-compute[70709]:   </cpu>
Jul 28 00:14:45 user nova-compute[70709]:   <devices>
Jul 28 00:14:45 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:14:45 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:14:45 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk"/>
Jul 28 00:14:45 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:14:45 user nova-compute[70709]:     </disk>
Jul 28 00:14:45 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:14:45 user nova-compute[70709]:       <mac address="fa:16:3e:03:3a:3b"/>
Jul 28 00:14:45 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:45 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:14:45 user nova-compute[70709]:       <target dev="tap84dc7a3e-6f"/>
Jul 28 00:14:45 user nova-compute[70709]:     </interface>
Jul 28 00:14:45 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:14:45 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/console.log" append="off"/>
Jul 28 00:14:45 user nova-compute[70709]:     </serial>
Jul 28 00:14:45 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:14:45 user nova-compute[70709]:     <video>
Jul 28 00:14:45 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:14:45 user nova-compute[70709]:     </video>
Jul 28 00:14:45 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:14:45 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:14:45 user nova-compute[70709]:     </rng>
Jul 28 00:14:45 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:14:45 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:14:45 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:14:45 user nova-compute[70709]:     </memballoon>
Jul 28 00:14:45 user nova-compute[70709]:   </devices>
Jul 28 00:14:45 user nova-compute[70709]: </domain>
Jul 28 00:14:45 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1549359080',display_name='tempest-ServerStableDeviceRescueTest-server-1549359080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1549359080',id=7,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwy4HneA3ZUmeqPHrbQse+qJUWEhfXTEMPBGDoaqxhrehEEkFn9HOsG11LJXknhyS0mntTrtVk8HXwWH6XqWK8W1vLqidE4n9cl+QqPNrxj8k61BRJMpjdt4hxKUVAzog==',key_name='tempest-keypair-154217269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f49049f887a4601b9788b7929269749',ramdisk_id='',reservation_id='r-cg2emlcr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-292119774',owner_user_name='tempest-ServerStableDeviceRescueTest-292119774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4bdf96671af4dcd81161e222a396d2e',uuid=a585b419-b9f5-4bd6-bbc9-cdfc4e732712,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Converting VIF {"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:3a:3b,bridge_name='br-int',has_traffic_filtering=True,id=84dc7a3e-6f63-4ff1-8689-38f607df3ae6,network=Network(de8b5a09-458a-445c-b0f7-21e454cb5d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc7a3e-6f') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG os_vif [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:3a:3b,bridge_name='br-int',has_traffic_filtering=True,id=84dc7a3e-6f63-4ff1-8689-38f607df3ae6,network=Network(de8b5a09-458a-445c-b0f7-21e454cb5d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc7a3e-6f') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84dc7a3e-6f, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84dc7a3e-6f, col_values=(('external_ids', {'iface-id': '84dc7a3e-6f63-4ff1-8689-38f607df3ae6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:3a:3b', 'vm-uuid': 'a585b419-b9f5-4bd6-bbc9-cdfc4e732712'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:14:45 user nova-compute[70709]: INFO os_vif [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:3a:3b,bridge_name='br-int',has_traffic_filtering=True,id=84dc7a3e-6f63-4ff1-8689-38f607df3ae6,network=Network(de8b5a09-458a-445c-b0f7-21e454cb5d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc7a3e-6f')
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503285.0942905, b61aaab4-ca86-41e6-a576-a7174d89a284 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] VM Resumed (Lifecycle Event)
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance spawned successfully.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Instance spawned successfully.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance spawned successfully.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Took 21.22 seconds to spawn the instance on the hypervisor.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Took 18.75 seconds to spawn the instance on the hypervisor.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503285.0995424, b61aaab4-ca86-41e6-a576-a7174d89a284 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] VM Started (Lifecycle Event)
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] No VIF found with MAC fa:16:3e:03:3a:3b, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-141a35de-c45d-42bd-916b-a93b663b44bf req-1155d272-6c12-41ac-b020-ccc08a06615e service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Received event network-vif-plugged-98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-141a35de-c45d-42bd-916b-a93b663b44bf req-1155d272-6c12-41ac-b020-ccc08a06615e service nova] Acquiring lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-141a35de-c45d-42bd-916b-a93b663b44bf req-1155d272-6c12-41ac-b020-ccc08a06615e service nova] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-141a35de-c45d-42bd-916b-a93b663b44bf req-1155d272-6c12-41ac-b020-ccc08a06615e service nova] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-141a35de-c45d-42bd-916b-a93b663b44bf req-1155d272-6c12-41ac-b020-ccc08a06615e service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] No waiting events found dispatching network-vif-plugged-98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:45 user nova-compute[70709]: WARNING nova.compute.manager [req-141a35de-c45d-42bd-916b-a93b663b44bf req-1155d272-6c12-41ac-b020-ccc08a06615e service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Received unexpected event network-vif-plugged-98291a12-0469-487a-8016-155a23415be0 for instance with vm_state building and task_state spawning.
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Took 22.16 seconds to build instance.
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Took 19.63 seconds to spawn the instance on the hypervisor.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Took 20.58 seconds to build instance.
Jul 28 00:14:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-99a9682c-4cc4-4dee-ae12-651cfa08a6a7 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.487s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:45 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503285.317154, 2bb828f4-bb7d-4754-bcaa-38f2954b8eee => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] VM Resumed (Lifecycle Event)
Jul 28 00:14:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b75564ca-1311-4548-bebb-aee260bba1dd tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "39bc08e9-7b3c-4698-921e-429823996ce1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.735s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503285.3233106, 2bb828f4-bb7d-4754-bcaa-38f2954b8eee => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] VM Started (Lifecycle Event)
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Took 17.93 seconds to spawn the instance on the hypervisor.
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Took 20.41 seconds to spawn the instance on the hypervisor.
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503285.3271058, 25c6e8f8-d23d-4ec9-932b-df0471d3e41b => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] VM Resumed (Lifecycle Event)
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Took 21.20 seconds to build instance.
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Took 21.23 seconds to build instance.
Jul 28 00:14:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2d4139ed-d6a1-45b0-97a3-012e0c9c9c71 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.367s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8b985e87-3478-49a3-b759-8c9d8ab467fc tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.409s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503285.331518, 25c6e8f8-d23d-4ec9-932b-df0471d3e41b => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] VM Started (Lifecycle Event)
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Took 18.96 seconds to build instance.
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-846c86eb-aab1-40aa-b2dd-561dfd064be4 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.158s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503285.352398, df55bbd3-31ab-42f8-9a71-4ed8e3c4428c => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] VM Resumed (Lifecycle Event)
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503285.3573794, df55bbd3-31ab-42f8-9a71-4ed8e3c4428c => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] VM Started (Lifecycle Event)
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-db81ccde-b065-4b77-a12b-e7ae71ff4f3d req-2980de50-c9c3-4ca5-a176-19e8e1b2b2a6 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-db81ccde-b065-4b77-a12b-e7ae71ff4f3d req-2980de50-c9c3-4ca5-a176-19e8e1b2b2a6 service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-db81ccde-b065-4b77-a12b-e7ae71ff4f3d req-2980de50-c9c3-4ca5-a176-19e8e1b2b2a6 service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-db81ccde-b065-4b77-a12b-e7ae71ff4f3d req-2980de50-c9c3-4ca5-a176-19e8e1b2b2a6 service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-db81ccde-b065-4b77-a12b-e7ae71ff4f3d req-2980de50-c9c3-4ca5-a176-19e8e1b2b2a6 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:47 user nova-compute[70709]: WARNING nova.compute.manager [req-db81ccde-b065-4b77-a12b-e7ae71ff4f3d req-2980de50-c9c3-4ca5-a176-19e8e1b2b2a6 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received unexpected event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with vm_state building and task_state spawning.
Jul 28 00:14:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-358e4452-6185-4813-9d6e-f7cad444f4d4 req-a92fbfa3-6bfe-4e2b-bc15-0520956a732e service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-358e4452-6185-4813-9d6e-f7cad444f4d4 req-a92fbfa3-6bfe-4e2b-bc15-0520956a732e service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-358e4452-6185-4813-9d6e-f7cad444f4d4 req-a92fbfa3-6bfe-4e2b-bc15-0520956a732e service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-358e4452-6185-4813-9d6e-f7cad444f4d4 req-a92fbfa3-6bfe-4e2b-bc15-0520956a732e service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-358e4452-6185-4813-9d6e-f7cad444f4d4 req-a92fbfa3-6bfe-4e2b-bc15-0520956a732e service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:14:50 user nova-compute[70709]: WARNING nova.compute.manager [req-358e4452-6185-4813-9d6e-f7cad444f4d4 req-a92fbfa3-6bfe-4e2b-bc15-0520956a732e service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received unexpected event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with vm_state building and task_state spawning.
Jul 28 00:14:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503290.7807248, a585b419-b9f5-4bd6-bbc9-cdfc4e732712 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:50 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] VM Resumed (Lifecycle Event)
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:14:50 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Instance spawned successfully.
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:14:50 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503290.7829576, a585b419-b9f5-4bd6-bbc9-cdfc4e732712 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:14:50 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] VM Started (Lifecycle Event)
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:14:51 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:14:51 user nova-compute[70709]: INFO nova.compute.manager [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Took 19.38 seconds to spawn the instance on the hypervisor.
Jul 28 00:14:51 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:14:51 user nova-compute[70709]: INFO nova.compute.manager [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Took 20.31 seconds to build instance.
Jul 28 00:14:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e52b97e8-7914-47ed-becb-8494f3a7b8f6 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.502s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:54 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:14:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:14:54 user nova-compute[70709]: INFO nova.compute.claims [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Claim successful on node user
Jul 28 00:14:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.888s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG nova.network.neutron [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:14:55 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 28 00:14:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:14:55 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Creating image(s)
Jul 28 00:14:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "/opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "/opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "/opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "89bafd29161ecab7af8b5b559be2e4b0a66b6806" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "89bafd29161ecab7af8b5b559be2e4b0a66b6806" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806.part --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:56 user nova-compute[70709]: DEBUG nova.policy [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '315e8b854d5546e98195e2fb6340469b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822cbb8b476c43f1a9fa2d932d9625ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:14:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806.part --force-share --output=json" returned: 0 in 0.213s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:56 user nova-compute[70709]: DEBUG nova.virt.images [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] bbb5145b-5bff-414c-8a94-7fa9b8fbc341 was qcow2, converting to raw {{(pid=70709) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 28 00:14:56 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:14:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806.part /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806.converted {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806.part /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806.converted" returned: 0 in 0.434s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806.converted --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806.converted --force-share --output=json" returned: 0 in 0.233s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "89bafd29161ecab7af8b5b559be2e4b0a66b6806" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.507s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806 --force-share --output=json" returned: 0 in 0.157s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "89bafd29161ecab7af8b5b559be2e4b0a66b6806" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "89bafd29161ecab7af8b5b559be2e4b0a66b6806" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806 --force-share --output=json" returned: 0 in 0.279s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806,backing_fmt=raw /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:14:57 user nova-compute[70709]: INFO nova.compute.claims [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Claim successful on node user
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806,backing_fmt=raw /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk 1073741824" returned: 0 in 0.058s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "89bafd29161ecab7af8b5b559be2e4b0a66b6806" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806 --force-share --output=json" returned: 0 in 0.266s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG nova.network.neutron [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Successfully created port: 2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk --force-share --output=json" returned: 0 in 0.376s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Cannot resize image /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG nova.objects.instance [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lazy-loading 'migration_context' on Instance uuid fadc10cd-bf2a-445f-8d0b-450cbed8fb8b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Ensure instance console log exists: /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.163s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.113s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:14:58 user nova-compute[70709]: INFO nova.compute.claims [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Claim successful on node user
Jul 28 00:14:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG nova.network.neutron [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:14:59 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:14:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:14:59 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Creating image(s)
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG nova.policy [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fbbbdee1153489ca8062e2dbf4dc5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428557cbe58946ccb2e7afd4bc9c233f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.225s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.216s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk 1073741824" returned: 0 in 0.098s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.078s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:14:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.network.neutron [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.262s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.network.neutron [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Successfully updated port: 2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:15:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.policy [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e2b4340066e43f79744c5119155f966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6125c0be794d138836e1315bfcbb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "refresh_cache-fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquired lock "refresh_cache-fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.network.neutron [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Cannot resize image /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.objects.instance [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lazy-loading 'migration_context' on Instance uuid 4789522e-1b10-41d7-9332-649b5aaf5270 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-47445a5e-99ec-4019-ac74-0aa3b3a68700 req-51ba9e7b-99a7-4c57-bc85-f1904967ca27 service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Received event network-changed-2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-47445a5e-99ec-4019-ac74-0aa3b3a68700 req-51ba9e7b-99a7-4c57-bc85-f1904967ca27 service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Refreshing instance network info cache due to event network-changed-2c14e4aa-47f7-4638-9571-de623dacdd7b. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-47445a5e-99ec-4019-ac74-0aa3b3a68700 req-51ba9e7b-99a7-4c57-bc85-f1904967ca27 service nova] Acquiring lock "refresh_cache-fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Ensure instance console log exists: /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.network.neutron [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:15:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Creating image(s)
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "/opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "/opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "/opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.223s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.101s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.network.neutron [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Successfully created port: 3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.233s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk 1073741824" returned: 0 in 0.071s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.network.neutron [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Updating instance_info_cache with network_info: [{"id": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "address": "fa:16:3e:b7:2f:37", "network": {"id": "227b7608-fa54-48a0-b970-0387ef09b50f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1366593134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822cbb8b476c43f1a9fa2d932d9625ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c14e4aa-47", "ovs_interfaceid": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Releasing lock "refresh_cache-fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Instance network_info: |[{"id": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "address": "fa:16:3e:b7:2f:37", "network": {"id": "227b7608-fa54-48a0-b970-0387ef09b50f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1366593134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822cbb8b476c43f1a9fa2d932d9625ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c14e4aa-47", "ovs_interfaceid": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-47445a5e-99ec-4019-ac74-0aa3b3a68700 req-51ba9e7b-99a7-4c57-bc85-f1904967ca27 service nova] Acquired lock "refresh_cache-fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.network.neutron [req-47445a5e-99ec-4019-ac74-0aa3b3a68700 req-51ba9e7b-99a7-4c57-bc85-f1904967ca27 service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Refreshing network info cache for port 2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Start _get_guest_xml network_info=[{"id": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "address": "fa:16:3e:b7:2f:37", "network": {"id": "227b7608-fa54-48a0-b970-0387ef09b50f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1366593134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822cbb8b476c43f1a9fa2d932d9625ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c14e4aa-47", "ovs_interfaceid": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:14:44Z,direct_url=<?>,disk_format='qcow2',id=bbb5145b-5bff-414c-8a94-7fa9b8fbc341,min_disk=0,min_ram=0,name='',owner='b132de49ed154e32be49f3d60565a7e9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:14:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/sda', 'encryption_options': None, 'image_id': 'bbb5145b-5bff-414c-8a94-7fa9b8fbc341'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:15:01 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:15:01 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:14:44Z,direct_url=<?>,disk_format='qcow2',id=bbb5145b-5bff-414c-8a94-7fa9b8fbc341,min_disk=0,min_ram=0,name='',owner='b132de49ed154e32be49f3d60565a7e9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:14:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1556765586',display_name='tempest-AttachSCSIVolumeTestJSON-server-1556765586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1556765586',id=8,image_ref='bbb5145b-5bff-414c-8a94-7fa9b8fbc341',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVk+n/ULg9wrcQ2fYGP7D5VrPNwUmIJrwymTTfd9FUSmwu/rSJwkBrLAitIhQXKz4bgB3RZUgStNFcTomrVqsZQ+GIswHb+7QYC2XVu0YRr/QGvcoNOCoJvXK9gar6KOg==',key_name='tempest-keypair-2094520553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='822cbb8b476c43f1a9fa2d932d9625ad',ramdisk_id='',reservation_id='r-cuswdeje',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbb5145b-5bff-414c-8a94-7fa9b8fbc341',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-711986765',owner_user_name='tempest-AttachSCSIVolumeTestJSON-711986765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315e8b854d5546e98195e2fb6340469b',uuid=fadc10cd-bf2a-445f-8d0b-450cbed8fb8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "address": "fa:16:3e:b7:2f:37", "network": {"id": "227b7608-fa54-48a0-b970-0387ef09b50f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1366593134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822cbb8b476c43f1a9fa2d932d9625ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c14e4aa-47", "ovs_interfaceid": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Converting VIF {"id": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "address": "fa:16:3e:b7:2f:37", "network": {"id": "227b7608-fa54-48a0-b970-0387ef09b50f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1366593134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822cbb8b476c43f1a9fa2d932d9625ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c14e4aa-47", "ovs_interfaceid": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=2c14e4aa-47f7-4638-9571-de623dacdd7b,network=Network(227b7608-fa54-48a0-b970-0387ef09b50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c14e4aa-47') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.objects.instance [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lazy-loading 'pci_devices' on Instance uuid fadc10cd-bf2a-445f-8d0b-450cbed8fb8b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.278s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Checking if we can resize image /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:15:01 user nova-compute[70709]:   <uuid>fadc10cd-bf2a-445f-8d0b-450cbed8fb8b</uuid>
Jul 28 00:15:01 user nova-compute[70709]:   <name>instance-00000008</name>
Jul 28 00:15:01 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:15:01 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:15:01 user nova-compute[70709]:   <metadata>
Jul 28 00:15:01 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:15:01 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:15:01 user nova-compute[70709]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1556765586</nova:name>
Jul 28 00:15:01 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:15:01</nova:creationTime>
Jul 28 00:15:01 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:15:01 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:15:01 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:15:01 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:15:01 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:15:01 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:15:01 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:15:01 user nova-compute[70709]:       <nova:owner>
Jul 28 00:15:01 user nova-compute[70709]:         <nova:user uuid="315e8b854d5546e98195e2fb6340469b">tempest-AttachSCSIVolumeTestJSON-711986765-project-member</nova:user>
Jul 28 00:15:01 user nova-compute[70709]:         <nova:project uuid="822cbb8b476c43f1a9fa2d932d9625ad">tempest-AttachSCSIVolumeTestJSON-711986765</nova:project>
Jul 28 00:15:01 user nova-compute[70709]:       </nova:owner>
Jul 28 00:15:01 user nova-compute[70709]:       <nova:root type="image" uuid="bbb5145b-5bff-414c-8a94-7fa9b8fbc341"/>
Jul 28 00:15:01 user nova-compute[70709]:       <nova:ports>
Jul 28 00:15:01 user nova-compute[70709]:         <nova:port uuid="2c14e4aa-47f7-4638-9571-de623dacdd7b">
Jul 28 00:15:01 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 28 00:15:01 user nova-compute[70709]:         </nova:port>
Jul 28 00:15:01 user nova-compute[70709]:       </nova:ports>
Jul 28 00:15:01 user nova-compute[70709]:     </nova:instance>
Jul 28 00:15:01 user nova-compute[70709]:   </metadata>
Jul 28 00:15:01 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:15:01 user nova-compute[70709]:     <system>
Jul 28 00:15:01 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:15:01 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:15:01 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:15:01 user nova-compute[70709]:       <entry name="serial">fadc10cd-bf2a-445f-8d0b-450cbed8fb8b</entry>
Jul 28 00:15:01 user nova-compute[70709]:       <entry name="uuid">fadc10cd-bf2a-445f-8d0b-450cbed8fb8b</entry>
Jul 28 00:15:01 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:15:01 user nova-compute[70709]:     </system>
Jul 28 00:15:01 user nova-compute[70709]:   </sysinfo>
Jul 28 00:15:01 user nova-compute[70709]:   <os>
Jul 28 00:15:01 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:15:01 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:15:01 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:15:01 user nova-compute[70709]:   </os>
Jul 28 00:15:01 user nova-compute[70709]:   <features>
Jul 28 00:15:01 user nova-compute[70709]:     <acpi/>
Jul 28 00:15:01 user nova-compute[70709]:     <apic/>
Jul 28 00:15:01 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:15:01 user nova-compute[70709]:   </features>
Jul 28 00:15:01 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:15:01 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:15:01 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:15:01 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:15:01 user nova-compute[70709]:   </clock>
Jul 28 00:15:01 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:15:01 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:15:01 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:15:01 user nova-compute[70709]:   </cpu>
Jul 28 00:15:01 user nova-compute[70709]:   <devices>
Jul 28 00:15:01 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:15:01 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:15:01 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk"/>
Jul 28 00:15:01 user nova-compute[70709]:       <target dev="sda" bus="scsi"/>
Jul 28 00:15:01 user nova-compute[70709]:       <address type="drive" controller="0" unit="0"/>
Jul 28 00:15:01 user nova-compute[70709]:     </disk>
Jul 28 00:15:01 user nova-compute[70709]:     <disk type="file" device="cdrom">
Jul 28 00:15:01 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none"/>
Jul 28 00:15:01 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk.config"/>
Jul 28 00:15:01 user nova-compute[70709]:       <target dev="sdb" bus="scsi"/>
Jul 28 00:15:01 user nova-compute[70709]:       <address type="drive" controller="0" unit="1"/>
Jul 28 00:15:01 user nova-compute[70709]:     </disk>
Jul 28 00:15:01 user nova-compute[70709]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 28 00:15:01 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:15:01 user nova-compute[70709]:       <mac address="fa:16:3e:b7:2f:37"/>
Jul 28 00:15:01 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:15:01 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:15:01 user nova-compute[70709]:       <target dev="tap2c14e4aa-47"/>
Jul 28 00:15:01 user nova-compute[70709]:     </interface>
Jul 28 00:15:01 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:15:01 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/console.log" append="off"/>
Jul 28 00:15:01 user nova-compute[70709]:     </serial>
Jul 28 00:15:01 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:15:01 user nova-compute[70709]:     <video>
Jul 28 00:15:01 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:15:01 user nova-compute[70709]:     </video>
Jul 28 00:15:01 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:15:01 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:15:01 user nova-compute[70709]:     </rng>
Jul 28 00:15:01 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:15:01 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:15:01 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:15:01 user nova-compute[70709]:     </memballoon>
Jul 28 00:15:01 user nova-compute[70709]:   </devices>
Jul 28 00:15:01 user nova-compute[70709]: </domain>
Jul 28 00:15:01 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1556765586',display_name='tempest-AttachSCSIVolumeTestJSON-server-1556765586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1556765586',id=8,image_ref='bbb5145b-5bff-414c-8a94-7fa9b8fbc341',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVk+n/ULg9wrcQ2fYGP7D5VrPNwUmIJrwymTTfd9FUSmwu/rSJwkBrLAitIhQXKz4bgB3RZUgStNFcTomrVqsZQ+GIswHb+7QYC2XVu0YRr/QGvcoNOCoJvXK9gar6KOg==',key_name='tempest-keypair-2094520553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='822cbb8b476c43f1a9fa2d932d9625ad',ramdisk_id='',reservation_id='r-cuswdeje',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbb5145b-5bff-414c-8a94-7fa9b8fbc341',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-711986765',owner_user_name='tempest-AttachSCSIVolumeTestJSON-711986765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315e8b854d5546e98195e2fb6340469b',uuid=fadc10cd-bf2a-445f-8d0b-450cbed8fb8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "address": "fa:16:3e:b7:2f:37", "network": {"id": "227b7608-fa54-48a0-b970-0387ef09b50f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1366593134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822cbb8b476c43f1a9fa2d932d9625ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c14e4aa-47", "ovs_interfaceid": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Converting VIF {"id": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "address": "fa:16:3e:b7:2f:37", "network": {"id": "227b7608-fa54-48a0-b970-0387ef09b50f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1366593134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822cbb8b476c43f1a9fa2d932d9625ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c14e4aa-47", "ovs_interfaceid": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=2c14e4aa-47f7-4638-9571-de623dacdd7b,network=Network(227b7608-fa54-48a0-b970-0387ef09b50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c14e4aa-47') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG os_vif [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=2c14e4aa-47f7-4638-9571-de623dacdd7b,network=Network(227b7608-fa54-48a0-b970-0387ef09b50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c14e4aa-47') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c14e4aa-47, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c14e4aa-47, col_values=(('external_ids', {'iface-id': '2c14e4aa-47f7-4638-9571-de623dacdd7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:2f:37', 'vm-uuid': 'fadc10cd-bf2a-445f-8d0b-450cbed8fb8b'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:01 user nova-compute[70709]: INFO os_vif [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=2c14e4aa-47f7-4638-9571-de623dacdd7b,network=Network(227b7608-fa54-48a0-b970-0387ef09b50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c14e4aa-47')
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.network.neutron [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Successfully created port: 49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Cannot resize image /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.objects.instance [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lazy-loading 'migration_context' on Instance uuid 169813c4-7d36-4660-b2fa-4a27fe3e8c86 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Ensure instance console log exists: /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] No BDM found with device name sda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:15:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] No VIF found with MAC fa:16:3e:b7:2f:37, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:15:01 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Using config drive
Jul 28 00:15:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Creating config drive at /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk.config
Jul 28 00:15:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppiw_quwp {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG nova.network.neutron [req-47445a5e-99ec-4019-ac74-0aa3b3a68700 req-51ba9e7b-99a7-4c57-bc85-f1904967ca27 service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Updated VIF entry in instance network info cache for port 2c14e4aa-47f7-4638-9571-de623dacdd7b. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG nova.network.neutron [req-47445a5e-99ec-4019-ac74-0aa3b3a68700 req-51ba9e7b-99a7-4c57-bc85-f1904967ca27 service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Updating instance_info_cache with network_info: [{"id": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "address": "fa:16:3e:b7:2f:37", "network": {"id": "227b7608-fa54-48a0-b970-0387ef09b50f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1366593134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822cbb8b476c43f1a9fa2d932d9625ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c14e4aa-47", "ovs_interfaceid": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppiw_quwp" returned: 0 in 0.063s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-47445a5e-99ec-4019-ac74-0aa3b3a68700 req-51ba9e7b-99a7-4c57-bc85-f1904967ca27 service nova] Releasing lock "refresh_cache-fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Successfully updated port: 49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "refresh_cache-169813c4-7d36-4660-b2fa-4a27fe3e8c86" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquired lock "refresh_cache-169813c4-7d36-4660-b2fa-4a27fe3e8c86" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-b5497635-8d83-4ebc-b6c8-1a8910c65156 req-03507688-cabc-4667-b836-ca0939709ead service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Received event network-changed-49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-b5497635-8d83-4ebc-b6c8-1a8910c65156 req-03507688-cabc-4667-b836-ca0939709ead service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Refreshing instance network info cache due to event network-changed-49c52655-67de-4f51-ba7d-0ba30b5b137d. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b5497635-8d83-4ebc-b6c8-1a8910c65156 req-03507688-cabc-4667-b836-ca0939709ead service nova] Acquiring lock "refresh_cache-169813c4-7d36-4660-b2fa-4a27fe3e8c86" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Successfully updated port: 3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquired lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-e8de2bd0-8a9e-42f2-9274-594d50bde205 req-211ce9b0-5446-4cc7-809d-20f097ea5253 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-changed-3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-e8de2bd0-8a9e-42f2-9274-594d50bde205 req-211ce9b0-5446-4cc7-809d-20f097ea5253 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Refreshing instance network info cache due to event network-changed-3a29154a-ca72-43a4-a111-81c2ac1be6f7. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e8de2bd0-8a9e-42f2-9274-594d50bde205 req-211ce9b0-5446-4cc7-809d-20f097ea5253 service nova] Acquiring lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.neutron [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.neutron [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updating instance_info_cache with network_info: [{"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Releasing lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Instance network_info: |[{"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e8de2bd0-8a9e-42f2-9274-594d50bde205 req-211ce9b0-5446-4cc7-809d-20f097ea5253 service nova] Acquired lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-e8de2bd0-8a9e-42f2-9274-594d50bde205 req-211ce9b0-5446-4cc7-809d-20f097ea5253 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Refreshing network info cache for port 3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Start _get_guest_xml network_info=[{"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:15:03 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:15:03 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-330796388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-330796388',id=9,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoBYj2u47hm72HhPB+cTlKzbBr01X98haFYfPWO+EXKwci2MxT+ZwG+mgNy/3QVDHnu7QwR0/IxM01QqzXGpS0obA/XwoFe0OALm1jPCLHs+e/CkiKFa7ONMv9sWpS8gg==',key_name='tempest-keypair-409851532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='428557cbe58946ccb2e7afd4bc9c233f',ramdisk_id='',reservation_id='r-6gkdaj2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1986096815',owner_user_name='tempest-TaggedAttachmentsTest-1986096815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fbbbdee1153489ca8062e2dbf4dc5df',uuid=4789522e-1b10-41d7-9332-649b5aaf5270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converting VIF {"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:03:ee,bridge_name='br-int',has_traffic_filtering=True,id=3a29154a-ca72-43a4-a111-81c2ac1be6f7,network=Network(f8ffaef5-7148-4019-a274-02eafcaae605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a29154a-ca') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lazy-loading 'pci_devices' on Instance uuid 4789522e-1b10-41d7-9332-649b5aaf5270 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.neutron [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Updating instance_info_cache with network_info: [{"id": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "address": "fa:16:3e:2b:ad:e1", "network": {"id": "6c016c68-c5f7-4d34-8635-a8a459fb21cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1698481621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6125c0be794d138836e1315bfcbb09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c52655-67", "ovs_interfaceid": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:15:03 user nova-compute[70709]:   <uuid>4789522e-1b10-41d7-9332-649b5aaf5270</uuid>
Jul 28 00:15:03 user nova-compute[70709]:   <name>instance-00000009</name>
Jul 28 00:15:03 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:15:03 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:15:03 user nova-compute[70709]:   <metadata>
Jul 28 00:15:03 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:15:03 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:name>tempest-device-tagging-server-330796388</nova:name>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:15:03</nova:creationTime>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:15:03 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:15:03 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:owner>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:user uuid="5fbbbdee1153489ca8062e2dbf4dc5df">tempest-TaggedAttachmentsTest-1986096815-project-member</nova:user>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:project uuid="428557cbe58946ccb2e7afd4bc9c233f">tempest-TaggedAttachmentsTest-1986096815</nova:project>
Jul 28 00:15:03 user nova-compute[70709]:       </nova:owner>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:ports>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:port uuid="3a29154a-ca72-43a4-a111-81c2ac1be6f7">
Jul 28 00:15:03 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 28 00:15:03 user nova-compute[70709]:         </nova:port>
Jul 28 00:15:03 user nova-compute[70709]:       </nova:ports>
Jul 28 00:15:03 user nova-compute[70709]:     </nova:instance>
Jul 28 00:15:03 user nova-compute[70709]:   </metadata>
Jul 28 00:15:03 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:15:03 user nova-compute[70709]:     <system>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="serial">4789522e-1b10-41d7-9332-649b5aaf5270</entry>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="uuid">4789522e-1b10-41d7-9332-649b5aaf5270</entry>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:15:03 user nova-compute[70709]:     </system>
Jul 28 00:15:03 user nova-compute[70709]:   </sysinfo>
Jul 28 00:15:03 user nova-compute[70709]:   <os>
Jul 28 00:15:03 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:15:03 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:15:03 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:15:03 user nova-compute[70709]:   </os>
Jul 28 00:15:03 user nova-compute[70709]:   <features>
Jul 28 00:15:03 user nova-compute[70709]:     <acpi/>
Jul 28 00:15:03 user nova-compute[70709]:     <apic/>
Jul 28 00:15:03 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:15:03 user nova-compute[70709]:   </features>
Jul 28 00:15:03 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:15:03 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:15:03 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:15:03 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:15:03 user nova-compute[70709]:   </clock>
Jul 28 00:15:03 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:15:03 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:15:03 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:15:03 user nova-compute[70709]:   </cpu>
Jul 28 00:15:03 user nova-compute[70709]:   <devices>
Jul 28 00:15:03 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:15:03 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:15:03 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk"/>
Jul 28 00:15:03 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:15:03 user nova-compute[70709]:     </disk>
Jul 28 00:15:03 user nova-compute[70709]:     <disk type="file" device="cdrom">
Jul 28 00:15:03 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none"/>
Jul 28 00:15:03 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk.config"/>
Jul 28 00:15:03 user nova-compute[70709]:       <target dev="hda" bus="ide"/>
Jul 28 00:15:03 user nova-compute[70709]:     </disk>
Jul 28 00:15:03 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:15:03 user nova-compute[70709]:       <mac address="fa:16:3e:44:03:ee"/>
Jul 28 00:15:03 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:15:03 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:15:03 user nova-compute[70709]:       <target dev="tap3a29154a-ca"/>
Jul 28 00:15:03 user nova-compute[70709]:     </interface>
Jul 28 00:15:03 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:15:03 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/console.log" append="off"/>
Jul 28 00:15:03 user nova-compute[70709]:     </serial>
Jul 28 00:15:03 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:15:03 user nova-compute[70709]:     <video>
Jul 28 00:15:03 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:15:03 user nova-compute[70709]:     </video>
Jul 28 00:15:03 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:15:03 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:15:03 user nova-compute[70709]:     </rng>
Jul 28 00:15:03 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:15:03 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:15:03 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:15:03 user nova-compute[70709]:     </memballoon>
Jul 28 00:15:03 user nova-compute[70709]:   </devices>
Jul 28 00:15:03 user nova-compute[70709]: </domain>
Jul 28 00:15:03 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-330796388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-330796388',id=9,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoBYj2u47hm72HhPB+cTlKzbBr01X98haFYfPWO+EXKwci2MxT+ZwG+mgNy/3QVDHnu7QwR0/IxM01QqzXGpS0obA/XwoFe0OALm1jPCLHs+e/CkiKFa7ONMv9sWpS8gg==',key_name='tempest-keypair-409851532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='428557cbe58946ccb2e7afd4bc9c233f',ramdisk_id='',reservation_id='r-6gkdaj2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1986096815',owner_user_name='tempest-TaggedAttachmentsTest-1986096815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fbbbdee1153489ca8062e2dbf4dc5df',uuid=4789522e-1b10-41d7-9332-649b5aaf5270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converting VIF {"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:03:ee,bridge_name='br-int',has_traffic_filtering=True,id=3a29154a-ca72-43a4-a111-81c2ac1be6f7,network=Network(f8ffaef5-7148-4019-a274-02eafcaae605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a29154a-ca') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG os_vif [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:03:ee,bridge_name='br-int',has_traffic_filtering=True,id=3a29154a-ca72-43a4-a111-81c2ac1be6f7,network=Network(f8ffaef5-7148-4019-a274-02eafcaae605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a29154a-ca') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a29154a-ca, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a29154a-ca, col_values=(('external_ids', {'iface-id': '3a29154a-ca72-43a4-a111-81c2ac1be6f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:03:ee', 'vm-uuid': '4789522e-1b10-41d7-9332-649b5aaf5270'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:03 user nova-compute[70709]: INFO os_vif [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:03:ee,bridge_name='br-int',has_traffic_filtering=True,id=3a29154a-ca72-43a4-a111-81c2ac1be6f7,network=Network(f8ffaef5-7148-4019-a274-02eafcaae605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a29154a-ca')
Jul 28 00:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Releasing lock "refresh_cache-169813c4-7d36-4660-b2fa-4a27fe3e8c86" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Instance network_info: |[{"id": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "address": "fa:16:3e:2b:ad:e1", "network": {"id": "6c016c68-c5f7-4d34-8635-a8a459fb21cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1698481621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6125c0be794d138836e1315bfcbb09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c52655-67", "ovs_interfaceid": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b5497635-8d83-4ebc-b6c8-1a8910c65156 req-03507688-cabc-4667-b836-ca0939709ead service nova] Acquired lock "refresh_cache-169813c4-7d36-4660-b2fa-4a27fe3e8c86" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-b5497635-8d83-4ebc-b6c8-1a8910c65156 req-03507688-cabc-4667-b836-ca0939709ead service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Refreshing network info cache for port 49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Start _get_guest_xml network_info=[{"id": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "address": "fa:16:3e:2b:ad:e1", "network": {"id": "6c016c68-c5f7-4d34-8635-a8a459fb21cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1698481621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6125c0be794d138836e1315bfcbb09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c52655-67", "ovs_interfaceid": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:15:03 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:15:03 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-792349985',display_name='tempest-TestVolumeSwap-server-792349985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-792349985',id=10,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICUJz/TdunTVrC8/6FVaARXTpCqW2e+Y9lsxnXKZbIADLOAZ+Ikcs9sY/QkRtud7LmRqYYk0uKcjb+ORcrY0snHxsDi8hSsBdfh5nstxZ6rF0V4bB0g+GkJyR/VwAVH6w==',key_name='tempest-keypair-486570714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa6125c0be794d138836e1315bfcbb09',ramdisk_id='',reservation_id='r-6s0j3ggi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1753490954',owner_user_name='tempest-TestVolumeSwap-1753490954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e2b4340066e43f79744c5119155f966',uuid=169813c4-7d36-4660-b2fa-4a27fe3e8c86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "address": "fa:16:3e:2b:ad:e1", "network": {"id": "6c016c68-c5f7-4d34-8635-a8a459fb21cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1698481621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6125c0be794d138836e1315bfcbb09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c52655-67", "ovs_interfaceid": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Converting VIF {"id": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "address": "fa:16:3e:2b:ad:e1", "network": {"id": "6c016c68-c5f7-4d34-8635-a8a459fb21cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1698481621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6125c0be794d138836e1315bfcbb09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c52655-67", "ovs_interfaceid": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=49c52655-67de-4f51-ba7d-0ba30b5b137d,network=Network(6c016c68-c5f7-4d34-8635-a8a459fb21cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c52655-67') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lazy-loading 'pci_devices' on Instance uuid 169813c4-7d36-4660-b2fa-4a27fe3e8c86 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:15:03 user nova-compute[70709]:   <uuid>169813c4-7d36-4660-b2fa-4a27fe3e8c86</uuid>
Jul 28 00:15:03 user nova-compute[70709]:   <name>instance-0000000a</name>
Jul 28 00:15:03 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:15:03 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:15:03 user nova-compute[70709]:   <metadata>
Jul 28 00:15:03 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:15:03 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:name>tempest-TestVolumeSwap-server-792349985</nova:name>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:15:03</nova:creationTime>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:15:03 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:15:03 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:owner>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:user uuid="4e2b4340066e43f79744c5119155f966">tempest-TestVolumeSwap-1753490954-project-member</nova:user>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:project uuid="aa6125c0be794d138836e1315bfcbb09">tempest-TestVolumeSwap-1753490954</nova:project>
Jul 28 00:15:03 user nova-compute[70709]:       </nova:owner>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:15:03 user nova-compute[70709]:       <nova:ports>
Jul 28 00:15:03 user nova-compute[70709]:         <nova:port uuid="49c52655-67de-4f51-ba7d-0ba30b5b137d">
Jul 28 00:15:03 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 28 00:15:03 user nova-compute[70709]:         </nova:port>
Jul 28 00:15:03 user nova-compute[70709]:       </nova:ports>
Jul 28 00:15:03 user nova-compute[70709]:     </nova:instance>
Jul 28 00:15:03 user nova-compute[70709]:   </metadata>
Jul 28 00:15:03 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:15:03 user nova-compute[70709]:     <system>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="serial">169813c4-7d36-4660-b2fa-4a27fe3e8c86</entry>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="uuid">169813c4-7d36-4660-b2fa-4a27fe3e8c86</entry>
Jul 28 00:15:03 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:15:03 user nova-compute[70709]:     </system>
Jul 28 00:15:03 user nova-compute[70709]:   </sysinfo>
Jul 28 00:15:03 user nova-compute[70709]:   <os>
Jul 28 00:15:03 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:15:03 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:15:03 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:15:03 user nova-compute[70709]:   </os>
Jul 28 00:15:03 user nova-compute[70709]:   <features>
Jul 28 00:15:03 user nova-compute[70709]:     <acpi/>
Jul 28 00:15:03 user nova-compute[70709]:     <apic/>
Jul 28 00:15:03 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:15:03 user nova-compute[70709]:   </features>
Jul 28 00:15:03 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:15:03 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:15:03 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:15:03 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:15:03 user nova-compute[70709]:   </clock>
Jul 28 00:15:03 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:15:03 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:15:03 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:15:03 user nova-compute[70709]:   </cpu>
Jul 28 00:15:03 user nova-compute[70709]:   <devices>
Jul 28 00:15:03 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:15:03 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:15:03 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk"/>
Jul 28 00:15:03 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:15:03 user nova-compute[70709]:     </disk>
Jul 28 00:15:03 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:15:03 user nova-compute[70709]:       <mac address="fa:16:3e:2b:ad:e1"/>
Jul 28 00:15:03 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:15:03 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:15:03 user nova-compute[70709]:       <target dev="tap49c52655-67"/>
Jul 28 00:15:03 user nova-compute[70709]:     </interface>
Jul 28 00:15:03 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:15:03 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/console.log" append="off"/>
Jul 28 00:15:03 user nova-compute[70709]:     </serial>
Jul 28 00:15:03 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:15:03 user nova-compute[70709]:     <video>
Jul 28 00:15:03 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:15:03 user nova-compute[70709]:     </video>
Jul 28 00:15:03 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:15:03 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:15:03 user nova-compute[70709]:     </rng>
Jul 28 00:15:03 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:15:03 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:15:03 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:15:03 user nova-compute[70709]:     </memballoon>
Jul 28 00:15:03 user nova-compute[70709]:   </devices>
Jul 28 00:15:03 user nova-compute[70709]: </domain>
Jul 28 00:15:03 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-792349985',display_name='tempest-TestVolumeSwap-server-792349985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-792349985',id=10,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICUJz/TdunTVrC8/6FVaARXTpCqW2e+Y9lsxnXKZbIADLOAZ+Ikcs9sY/QkRtud7LmRqYYk0uKcjb+ORcrY0snHxsDi8hSsBdfh5nstxZ6rF0V4bB0g+GkJyR/VwAVH6w==',key_name='tempest-keypair-486570714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa6125c0be794d138836e1315bfcbb09',ramdisk_id='',reservation_id='r-6s0j3ggi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1753490954',owner_user_name='tempest-TestVolumeSwap-1753490954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e2b4340066e43f79744c5119155f966',uuid=169813c4-7d36-4660-b2fa-4a27fe3e8c86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "address": "fa:16:3e:2b:ad:e1", "network": {"id": "6c016c68-c5f7-4d34-8635-a8a459fb21cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1698481621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6125c0be794d138836e1315bfcbb09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c52655-67", "ovs_interfaceid": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Converting VIF {"id": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "address": "fa:16:3e:2b:ad:e1", "network": {"id": "6c016c68-c5f7-4d34-8635-a8a459fb21cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1698481621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6125c0be794d138836e1315bfcbb09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c52655-67", "ovs_interfaceid": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=49c52655-67de-4f51-ba7d-0ba30b5b137d,network=Network(6c016c68-c5f7-4d34-8635-a8a459fb21cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c52655-67') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG os_vif [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=49c52655-67de-4f51-ba7d-0ba30b5b137d,network=Network(6c016c68-c5f7-4d34-8635-a8a459fb21cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c52655-67') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49c52655-67, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49c52655-67, col_values=(('external_ids', {'iface-id': '49c52655-67de-4f51-ba7d-0ba30b5b137d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:ad:e1', 'vm-uuid': '169813c4-7d36-4660-b2fa-4a27fe3e8c86'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] No BDM found with device name hda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] No VIF found with MAC fa:16:3e:44:03:ee, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:15:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Using config drive
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:03 user nova-compute[70709]: INFO os_vif [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=49c52655-67de-4f51-ba7d-0ba30b5b137d,network=Network(6c016c68-c5f7-4d34-8635-a8a459fb21cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c52655-67')
Jul 28 00:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] No VIF found with MAC fa:16:3e:2b:ad:e1, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:15:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Creating config drive at /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk.config
Jul 28 00:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppc6mtjza {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppc6mtjza" returned: 0 in 0.075s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-b5497635-8d83-4ebc-b6c8-1a8910c65156 req-03507688-cabc-4667-b836-ca0939709ead service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Updated VIF entry in instance network info cache for port 49c52655-67de-4f51-ba7d-0ba30b5b137d. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-b5497635-8d83-4ebc-b6c8-1a8910c65156 req-03507688-cabc-4667-b836-ca0939709ead service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Updating instance_info_cache with network_info: [{"id": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "address": "fa:16:3e:2b:ad:e1", "network": {"id": "6c016c68-c5f7-4d34-8635-a8a459fb21cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1698481621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6125c0be794d138836e1315bfcbb09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c52655-67", "ovs_interfaceid": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b5497635-8d83-4ebc-b6c8-1a8910c65156 req-03507688-cabc-4667-b836-ca0939709ead service nova] Releasing lock "refresh_cache-169813c4-7d36-4660-b2fa-4a27fe3e8c86" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-e8de2bd0-8a9e-42f2-9274-594d50bde205 req-211ce9b0-5446-4cc7-809d-20f097ea5253 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updated VIF entry in instance network info cache for port 3a29154a-ca72-43a4-a111-81c2ac1be6f7. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-e8de2bd0-8a9e-42f2-9274-594d50bde205 req-211ce9b0-5446-4cc7-809d-20f097ea5253 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updating instance_info_cache with network_info: [{"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e8de2bd0-8a9e-42f2-9274-594d50bde205 req-211ce9b0-5446-4cc7-809d-20f097ea5253 service nova] Releasing lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Received event network-vif-plugged-2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] Acquiring lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] No waiting events found dispatching network-vif-plugged-2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:15:05 user nova-compute[70709]: WARNING nova.compute.manager [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Received unexpected event network-vif-plugged-2c14e4aa-47f7-4638-9571-de623dacdd7b for instance with vm_state building and task_state spawning.
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Received event network-vif-plugged-2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] Acquiring lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] No waiting events found dispatching network-vif-plugged-2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:15:05 user nova-compute[70709]: WARNING nova.compute.manager [req-41157a24-f2b3-4be9-8ada-cbd0da43565d req-c60fcf18-c46e-4c0e-be3b-330972a6f23c service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Received unexpected event network-vif-plugged-2c14e4aa-47f7-4638-9571-de623dacdd7b for instance with vm_state building and task_state spawning.
Jul 28 00:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Acquiring lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:15:05 user nova-compute[70709]: INFO nova.compute.claims [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Claim successful on node user
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.network.neutron [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:15:05 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:15:05 user nova-compute[70709]: DEBUG nova.policy [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a60567e498d64f9c8d9dd088ac3472fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76641fb174734c318eb37e92d14d97a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:15:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Creating image(s)
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "/opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "/opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk 1073741824" returned: 0 in 0.049s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG nova.network.neutron [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Successfully created port: f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Cannot resize image /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG nova.objects.instance [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lazy-loading 'migration_context' on Instance uuid 7cb91b91-a2ec-4baf-bffe-e83aafd26a02 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Ensure instance console log exists: /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-c0b26eeb-5f1b-4f37-9b3e-efcb665fccfd req-2e832f33-e499-4647-94ff-c06227055c9a service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Received event network-vif-plugged-49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c0b26eeb-5f1b-4f37-9b3e-efcb665fccfd req-2e832f33-e499-4647-94ff-c06227055c9a service nova] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c0b26eeb-5f1b-4f37-9b3e-efcb665fccfd req-2e832f33-e499-4647-94ff-c06227055c9a service nova] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c0b26eeb-5f1b-4f37-9b3e-efcb665fccfd req-2e832f33-e499-4647-94ff-c06227055c9a service nova] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-c0b26eeb-5f1b-4f37-9b3e-efcb665fccfd req-2e832f33-e499-4647-94ff-c06227055c9a service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] No waiting events found dispatching network-vif-plugged-49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:15:07 user nova-compute[70709]: WARNING nova.compute.manager [req-c0b26eeb-5f1b-4f37-9b3e-efcb665fccfd req-2e832f33-e499-4647-94ff-c06227055c9a service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Received unexpected event network-vif-plugged-49c52655-67de-4f51-ba7d-0ba30b5b137d for instance with vm_state building and task_state spawning.
Jul 28 00:15:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-bc172dff-edf8-4650-8e6d-20218737cf20 req-c5657093-3106-47f4-bc0e-cc23f339d70d service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-vif-plugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bc172dff-edf8-4650-8e6d-20218737cf20 req-c5657093-3106-47f4-bc0e-cc23f339d70d service nova] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bc172dff-edf8-4650-8e6d-20218737cf20 req-c5657093-3106-47f4-bc0e-cc23f339d70d service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bc172dff-edf8-4650-8e6d-20218737cf20 req-c5657093-3106-47f4-bc0e-cc23f339d70d service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-bc172dff-edf8-4650-8e6d-20218737cf20 req-c5657093-3106-47f4-bc0e-cc23f339d70d service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] No waiting events found dispatching network-vif-plugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:15:07 user nova-compute[70709]: WARNING nova.compute.manager [req-bc172dff-edf8-4650-8e6d-20218737cf20 req-c5657093-3106-47f4-bc0e-cc23f339d70d service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received unexpected event network-vif-plugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 for instance with vm_state building and task_state spawning.
Jul 28 00:15:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Successfully updated port: f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Acquiring lock "refresh_cache-7cb91b91-a2ec-4baf-bffe-e83aafd26a02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Acquired lock "refresh_cache-7cb91b91-a2ec-4baf-bffe-e83aafd26a02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Updating instance_info_cache with network_info: [{"id": "f87fe565-011d-4475-b3af-11cef08ed7d9", "address": "fa:16:3e:cf:59:f8", "network": {"id": "9c2370f4-26c4-4160-8ea6-e43d8ab0533d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1300993732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76641fb174734c318eb37e92d14d97a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87fe565-01", "ovs_interfaceid": "f87fe565-011d-4475-b3af-11cef08ed7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Releasing lock "refresh_cache-7cb91b91-a2ec-4baf-bffe-e83aafd26a02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.compute.manager [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Instance network_info: |[{"id": "f87fe565-011d-4475-b3af-11cef08ed7d9", "address": "fa:16:3e:cf:59:f8", "network": {"id": "9c2370f4-26c4-4160-8ea6-e43d8ab0533d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1300993732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76641fb174734c318eb37e92d14d97a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87fe565-01", "ovs_interfaceid": "f87fe565-011d-4475-b3af-11cef08ed7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Start _get_guest_xml network_info=[{"id": "f87fe565-011d-4475-b3af-11cef08ed7d9", "address": "fa:16:3e:cf:59:f8", "network": {"id": "9c2370f4-26c4-4160-8ea6-e43d8ab0533d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1300993732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76641fb174734c318eb37e92d14d97a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87fe565-01", "ovs_interfaceid": "f87fe565-011d-4475-b3af-11cef08ed7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:15:08 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:15:08 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-969363868',display_name='tempest-VolumesActionsTest-instance-969363868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-969363868',id=11,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76641fb174734c318eb37e92d14d97a3',ramdisk_id='',reservation_id='r-yqgv2r7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1261321922',owner_user_name='tempest-VolumesActionsTest-1261321922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:06Z,user_data=None,user_id='a60567e498d64f9c8d9dd088ac3472fa',uuid=7cb91b91-a2ec-4baf-bffe-e83aafd26a02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f87fe565-011d-4475-b3af-11cef08ed7d9", "address": "fa:16:3e:cf:59:f8", "network": {"id": "9c2370f4-26c4-4160-8ea6-e43d8ab0533d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1300993732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76641fb174734c318eb37e92d14d97a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87fe565-01", "ovs_interfaceid": "f87fe565-011d-4475-b3af-11cef08ed7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Converting VIF {"id": "f87fe565-011d-4475-b3af-11cef08ed7d9", "address": "fa:16:3e:cf:59:f8", "network": {"id": "9c2370f4-26c4-4160-8ea6-e43d8ab0533d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1300993732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76641fb174734c318eb37e92d14d97a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87fe565-01", "ovs_interfaceid": "f87fe565-011d-4475-b3af-11cef08ed7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:59:f8,bridge_name='br-int',has_traffic_filtering=True,id=f87fe565-011d-4475-b3af-11cef08ed7d9,network=Network(9c2370f4-26c4-4160-8ea6-e43d8ab0533d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87fe565-01') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cb91b91-a2ec-4baf-bffe-e83aafd26a02 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:15:08 user nova-compute[70709]:   <uuid>7cb91b91-a2ec-4baf-bffe-e83aafd26a02</uuid>
Jul 28 00:15:08 user nova-compute[70709]:   <name>instance-0000000b</name>
Jul 28 00:15:08 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:15:08 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:15:08 user nova-compute[70709]:   <metadata>
Jul 28 00:15:08 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:15:08 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:15:08 user nova-compute[70709]:       <nova:name>tempest-VolumesActionsTest-instance-969363868</nova:name>
Jul 28 00:15:08 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:15:08</nova:creationTime>
Jul 28 00:15:08 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:15:08 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:15:08 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:15:08 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:15:08 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:15:08 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:15:08 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:15:08 user nova-compute[70709]:       <nova:owner>
Jul 28 00:15:08 user nova-compute[70709]:         <nova:user uuid="a60567e498d64f9c8d9dd088ac3472fa">tempest-VolumesActionsTest-1261321922-project-member</nova:user>
Jul 28 00:15:08 user nova-compute[70709]:         <nova:project uuid="76641fb174734c318eb37e92d14d97a3">tempest-VolumesActionsTest-1261321922</nova:project>
Jul 28 00:15:08 user nova-compute[70709]:       </nova:owner>
Jul 28 00:15:08 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:15:08 user nova-compute[70709]:       <nova:ports>
Jul 28 00:15:08 user nova-compute[70709]:         <nova:port uuid="f87fe565-011d-4475-b3af-11cef08ed7d9">
Jul 28 00:15:08 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 28 00:15:08 user nova-compute[70709]:         </nova:port>
Jul 28 00:15:08 user nova-compute[70709]:       </nova:ports>
Jul 28 00:15:08 user nova-compute[70709]:     </nova:instance>
Jul 28 00:15:08 user nova-compute[70709]:   </metadata>
Jul 28 00:15:08 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:15:08 user nova-compute[70709]:     <system>
Jul 28 00:15:08 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:15:08 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:15:08 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:15:08 user nova-compute[70709]:       <entry name="serial">7cb91b91-a2ec-4baf-bffe-e83aafd26a02</entry>
Jul 28 00:15:08 user nova-compute[70709]:       <entry name="uuid">7cb91b91-a2ec-4baf-bffe-e83aafd26a02</entry>
Jul 28 00:15:08 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:15:08 user nova-compute[70709]:     </system>
Jul 28 00:15:08 user nova-compute[70709]:   </sysinfo>
Jul 28 00:15:08 user nova-compute[70709]:   <os>
Jul 28 00:15:08 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:15:08 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:15:08 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:15:08 user nova-compute[70709]:   </os>
Jul 28 00:15:08 user nova-compute[70709]:   <features>
Jul 28 00:15:08 user nova-compute[70709]:     <acpi/>
Jul 28 00:15:08 user nova-compute[70709]:     <apic/>
Jul 28 00:15:08 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:15:08 user nova-compute[70709]:   </features>
Jul 28 00:15:08 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:15:08 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:15:08 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:15:08 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:15:08 user nova-compute[70709]:   </clock>
Jul 28 00:15:08 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:15:08 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:15:08 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:15:08 user nova-compute[70709]:   </cpu>
Jul 28 00:15:08 user nova-compute[70709]:   <devices>
Jul 28 00:15:08 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:15:08 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:15:08 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk"/>
Jul 28 00:15:08 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:15:08 user nova-compute[70709]:     </disk>
Jul 28 00:15:08 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:15:08 user nova-compute[70709]:       <mac address="fa:16:3e:cf:59:f8"/>
Jul 28 00:15:08 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:15:08 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:15:08 user nova-compute[70709]:       <target dev="tapf87fe565-01"/>
Jul 28 00:15:08 user nova-compute[70709]:     </interface>
Jul 28 00:15:08 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:15:08 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/console.log" append="off"/>
Jul 28 00:15:08 user nova-compute[70709]:     </serial>
Jul 28 00:15:08 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:15:08 user nova-compute[70709]:     <video>
Jul 28 00:15:08 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:15:08 user nova-compute[70709]:     </video>
Jul 28 00:15:08 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:15:08 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:15:08 user nova-compute[70709]:     </rng>
Jul 28 00:15:08 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:15:08 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:15:08 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:15:08 user nova-compute[70709]:     </memballoon>
Jul 28 00:15:08 user nova-compute[70709]:   </devices>
Jul 28 00:15:08 user nova-compute[70709]: </domain>
Jul 28 00:15:08 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-969363868',display_name='tempest-VolumesActionsTest-instance-969363868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-969363868',id=11,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76641fb174734c318eb37e92d14d97a3',ramdisk_id='',reservation_id='r-yqgv2r7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1261321922',owner_user_name='tempest-VolumesActionsTest-1261321922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:06Z,user_data=None,user_id='a60567e498d64f9c8d9dd088ac3472fa',uuid=7cb91b91-a2ec-4baf-bffe-e83aafd26a02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f87fe565-011d-4475-b3af-11cef08ed7d9", "address": "fa:16:3e:cf:59:f8", "network": {"id": "9c2370f4-26c4-4160-8ea6-e43d8ab0533d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1300993732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76641fb174734c318eb37e92d14d97a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87fe565-01", "ovs_interfaceid": "f87fe565-011d-4475-b3af-11cef08ed7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Converting VIF {"id": "f87fe565-011d-4475-b3af-11cef08ed7d9", "address": "fa:16:3e:cf:59:f8", "network": {"id": "9c2370f4-26c4-4160-8ea6-e43d8ab0533d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1300993732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76641fb174734c318eb37e92d14d97a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87fe565-01", "ovs_interfaceid": "f87fe565-011d-4475-b3af-11cef08ed7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:59:f8,bridge_name='br-int',has_traffic_filtering=True,id=f87fe565-011d-4475-b3af-11cef08ed7d9,network=Network(9c2370f4-26c4-4160-8ea6-e43d8ab0533d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87fe565-01') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG os_vif [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:59:f8,bridge_name='br-int',has_traffic_filtering=True,id=f87fe565-011d-4475-b3af-11cef08ed7d9,network=Network(9c2370f4-26c4-4160-8ea6-e43d8ab0533d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87fe565-01') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf87fe565-01, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf87fe565-01, col_values=(('external_ids', {'iface-id': 'f87fe565-011d-4475-b3af-11cef08ed7d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:59:f8', 'vm-uuid': '7cb91b91-a2ec-4baf-bffe-e83aafd26a02'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:08 user nova-compute[70709]: INFO os_vif [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:59:f8,bridge_name='br-int',has_traffic_filtering=True,id=f87fe565-011d-4475-b3af-11cef08ed7d9,network=Network(9c2370f4-26c4-4160-8ea6-e43d8ab0533d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87fe565-01')
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:15:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] No VIF found with MAC fa:16:3e:cf:59:f8, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-bcfa3b30-25c5-4f26-b992-d0c2eb8cd3b5 req-30436a40-a5a1-4e99-b040-2559082f12dd service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-vif-plugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bcfa3b30-25c5-4f26-b992-d0c2eb8cd3b5 req-30436a40-a5a1-4e99-b040-2559082f12dd service nova] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bcfa3b30-25c5-4f26-b992-d0c2eb8cd3b5 req-30436a40-a5a1-4e99-b040-2559082f12dd service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bcfa3b30-25c5-4f26-b992-d0c2eb8cd3b5 req-30436a40-a5a1-4e99-b040-2559082f12dd service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-bcfa3b30-25c5-4f26-b992-d0c2eb8cd3b5 req-30436a40-a5a1-4e99-b040-2559082f12dd service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] No waiting events found dispatching network-vif-plugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:15:09 user nova-compute[70709]: WARNING nova.compute.manager [req-bcfa3b30-25c5-4f26-b992-d0c2eb8cd3b5 req-30436a40-a5a1-4e99-b040-2559082f12dd service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received unexpected event network-vif-plugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 for instance with vm_state building and task_state spawning.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503309.3059864, fadc10cd-bf2a-445f-8d0b-450cbed8fb8b => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] VM Resumed (Lifecycle Event)
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Instance spawned successfully.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503309.307716, fadc10cd-bf2a-445f-8d0b-450cbed8fb8b => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] VM Started (Lifecycle Event)
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Received event network-vif-plugged-49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] No waiting events found dispatching network-vif-plugged-49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:15:09 user nova-compute[70709]: WARNING nova.compute.manager [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Received unexpected event network-vif-plugged-49c52655-67de-4f51-ba7d-0ba30b5b137d for instance with vm_state building and task_state spawning.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Received event network-changed-f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Refreshing instance network info cache due to event network-changed-f87fe565-011d-4475-b3af-11cef08ed7d9. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] Acquiring lock "refresh_cache-7cb91b91-a2ec-4baf-bffe-e83aafd26a02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] Acquired lock "refresh_cache-7cb91b91-a2ec-4baf-bffe-e83aafd26a02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.network.neutron [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Refreshing network info cache for port f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Took 13.70 seconds to spawn the instance on the hypervisor.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Took 15.01 seconds to build instance.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6b2f1f62-2857-450d-a8ad-78484ab7499e tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.166s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503309.7297828, 4789522e-1b10-41d7-9332-649b5aaf5270 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] VM Resumed (Lifecycle Event)
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Instance spawned successfully.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503309.729932, 4789522e-1b10-41d7-9332-649b5aaf5270 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] VM Started (Lifecycle Event)
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Instance spawned successfully.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503309.84122, 169813c4-7d36-4660-b2fa-4a27fe3e8c86 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] VM Resumed (Lifecycle Event)
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Took 10.65 seconds to spawn the instance on the hypervisor.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:15:09 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503309.841312, 169813c4-7d36-4660-b2fa-4a27fe3e8c86 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:15:09 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] VM Started (Lifecycle Event)
Jul 28 00:15:10 user nova-compute[70709]: INFO nova.compute.manager [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Took 12.34 seconds to build instance.
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:10 user nova-compute[70709]: INFO nova.compute.manager [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Took 9.45 seconds to spawn the instance on the hypervisor.
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-895846a6-7963-4bf3-9687-bc88db2ceb1f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.612s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.network.neutron [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Updated VIF entry in instance network info cache for port f87fe565-011d-4475-b3af-11cef08ed7d9. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.network.neutron [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Updating instance_info_cache with network_info: [{"id": "f87fe565-011d-4475-b3af-11cef08ed7d9", "address": "fa:16:3e:cf:59:f8", "network": {"id": "9c2370f4-26c4-4160-8ea6-e43d8ab0533d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1300993732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76641fb174734c318eb37e92d14d97a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87fe565-01", "ovs_interfaceid": "f87fe565-011d-4475-b3af-11cef08ed7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb77ea02-a5c7-4dd9-a936-e5280a2e9505 req-06263ede-ac86-4645-8585-fd8d6d208309 service nova] Releasing lock "refresh_cache-7cb91b91-a2ec-4baf-bffe-e83aafd26a02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:10 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:15:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:10 user nova-compute[70709]: INFO nova.compute.manager [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Took 11.65 seconds to build instance.
Jul 28 00:15:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4fa298b4-9054-405d-a960-2a7fd7a65fe8 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.811s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-4d5b6f5d-ca6e-4a7f-b8b0-57d39a5273a3 req-b0c1491e-a0e2-46c8-b8bf-af552443a878 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Received event network-vif-plugged-f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4d5b6f5d-ca6e-4a7f-b8b0-57d39a5273a3 req-b0c1491e-a0e2-46c8-b8bf-af552443a878 service nova] Acquiring lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4d5b6f5d-ca6e-4a7f-b8b0-57d39a5273a3 req-b0c1491e-a0e2-46c8-b8bf-af552443a878 service nova] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4d5b6f5d-ca6e-4a7f-b8b0-57d39a5273a3 req-b0c1491e-a0e2-46c8-b8bf-af552443a878 service nova] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-4d5b6f5d-ca6e-4a7f-b8b0-57d39a5273a3 req-b0c1491e-a0e2-46c8-b8bf-af552443a878 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] No waiting events found dispatching network-vif-plugged-f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:15:10 user nova-compute[70709]: WARNING nova.compute.manager [req-4d5b6f5d-ca6e-4a7f-b8b0-57d39a5273a3 req-b0c1491e-a0e2-46c8-b8bf-af552443a878 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Received unexpected event network-vif-plugged-f87fe565-011d-4475-b3af-11cef08ed7d9 for instance with vm_state building and task_state spawning.
Jul 28 00:15:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Skipping network cache update for instance because it is Building. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-d007829f-9716-4aac-aaa5-e2c9becbe299" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-d007829f-9716-4aac-aaa5-e2c9becbe299" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:15:10 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid d007829f-9716-4aac-aaa5-e2c9becbe299 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Updating instance_info_cache with network_info: [{"id": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "address": "fa:16:3e:b6:d0:a1", "network": {"id": "04b1db21-ffaa-4b59-853c-c32f011c1e4a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431996065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eef809cb1ad7477cb6cbeb995587a1e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ac23ce-a2", "ovs_interfaceid": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-d007829f-9716-4aac-aaa5-e2c9becbe299" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:15:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-a423d486-4b91-4990-868a-4d9901b0a34c req-5ee66401-893a-4240-bcff-41b78a544fe3 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Received event network-vif-plugged-f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a423d486-4b91-4990-868a-4d9901b0a34c req-5ee66401-893a-4240-bcff-41b78a544fe3 service nova] Acquiring lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a423d486-4b91-4990-868a-4d9901b0a34c req-5ee66401-893a-4240-bcff-41b78a544fe3 service nova] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a423d486-4b91-4990-868a-4d9901b0a34c req-5ee66401-893a-4240-bcff-41b78a544fe3 service nova] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-a423d486-4b91-4990-868a-4d9901b0a34c req-5ee66401-893a-4240-bcff-41b78a544fe3 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] No waiting events found dispatching network-vif-plugged-f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:15:12 user nova-compute[70709]: WARNING nova.compute.manager [req-a423d486-4b91-4990-868a-4d9901b0a34c req-5ee66401-893a-4240-bcff-41b78a544fe3 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Received unexpected event network-vif-plugged-f87fe565-011d-4475-b3af-11cef08ed7d9 for instance with vm_state building and task_state spawning.
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503313.0429962, 7cb91b91-a2ec-4baf-bffe-e83aafd26a02 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:15:13 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] VM Resumed (Lifecycle Event)
Jul 28 00:15:13 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Instance spawned successfully.
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:13 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503313.044944, 7cb91b91-a2ec-4baf-bffe-e83aafd26a02 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:15:13 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] VM Started (Lifecycle Event)
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:15:13 user nova-compute[70709]: INFO nova.compute.manager [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Took 7.21 seconds to spawn the instance on the hypervisor.
Jul 28 00:15:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:15:13 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:15:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:13 user nova-compute[70709]: INFO nova.compute.manager [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Took 8.10 seconds to build instance.
Jul 28 00:15:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-59d739d2-6d27-4a48-8431-e6b861b8fa29 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.207s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:15:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:15:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7337MB free_disk=25.67200469970703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:15:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance d007829f-9716-4aac-aaa5-e2c9becbe299 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance df55bbd3-31ab-42f8-9a71-4ed8e3c4428c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance fadc10cd-bf2a-445f-8d0b-450cbed8fb8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4789522e-1b10-41d7-9332-649b5aaf5270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 169813c4-7d36-4660-b2fa-4a27fe3e8c86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 7cb91b91-a2ec-4baf-bffe-e83aafd26a02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:15:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.980s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:15:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "22b20888-013f-4130-a709-dd7d7932ad80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:36 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:15:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:15:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:15:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:15:36 user nova-compute[70709]: INFO nova.compute.claims [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Claim successful on node user
Jul 28 00:15:37 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:15:37 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:15:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:15:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:15:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:15:37 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:15:37 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:15:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:15:37 user nova-compute[70709]: INFO nova.virt.block_device [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Booting with volume 9934460d-deb7-473b-aab3-fd4b53be4234 at /dev/vda
Jul 28 00:15:37 user nova-compute[70709]: DEBUG nova.policy [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1313461455149229baa40380a1b9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1e74bcec444c19a7caccfec7a5495c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:15:37 user nova-compute[70709]: DEBUG os_brick.utils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:15:37 user nova-compute[70709]: INFO oslo.privsep.daemon [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpc708gsu0/privsep.sock']
Jul 28 00:15:37 user sudo[82450]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpc708gsu0/privsep.sock
Jul 28 00:15:37 user sudo[82450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 28 00:15:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully created port: ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:15:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully created port: 0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:15:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:39 user sudo[82450]: pam_unix(sudo:session): session closed for user root
Jul 28 00:15:39 user nova-compute[70709]: INFO oslo.privsep.daemon [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Spawned new privsep daemon via rootwrap
Jul 28 00:15:39 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 28 00:15:39 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 28 00:15:39 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 28 00:15:39 user nova-compute[70709]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82455
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d340e4b-b9fb-4526-8475-cc0218c150f7]: (2,) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaf959b-d73c-422c-bb2f-fab10c2f29a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:39 user nova-compute[70709]: WARNING os_brick.initiator.connectors.nvmeof [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7220574-2873-4829-8ce1-73cc1fa6e241]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c593d70f-0c6b-41b8-833d-9ac502bbf17d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef44bd7-ed13-413e-b405-7b4c8772db29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:15:39 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:15:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba92af5b-89bb-466a-9dd2-bbd7323fcad5]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG os_brick.utils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] <== get_connector_properties: return (2005ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating existing volume attachment record: e21bac05-7d48-4c3f-9f73-d4e3da3cfa08 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:15:39 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully created port: 18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:15:40 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully created port: 90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:15:40 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully created port: 2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:15:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:41 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully updated port: ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:15:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-77728ddf-4122-4b9a-98dd-33a2f860c189 req-34299f6e-741e-4f0f-b9fc-5499f05c90ea service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-changed-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-77728ddf-4122-4b9a-98dd-33a2f860c189 req-34299f6e-741e-4f0f-b9fc-5499f05c90ea service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing instance network info cache due to event network-changed-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:15:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-77728ddf-4122-4b9a-98dd-33a2f860c189 req-34299f6e-741e-4f0f-b9fc-5499f05c90ea service nova] Acquiring lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-77728ddf-4122-4b9a-98dd-33a2f860c189 req-34299f6e-741e-4f0f-b9fc-5499f05c90ea service nova] Acquired lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-77728ddf-4122-4b9a-98dd-33a2f860c189 req-34299f6e-741e-4f0f-b9fc-5499f05c90ea service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing network info cache for port ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:15:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-77728ddf-4122-4b9a-98dd-33a2f860c189 req-34299f6e-741e-4f0f-b9fc-5499f05c90ea service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:15:42 user nova-compute[70709]: DEBUG nova.network.neutron [req-77728ddf-4122-4b9a-98dd-33a2f860c189 req-34299f6e-741e-4f0f-b9fc-5499f05c90ea service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-77728ddf-4122-4b9a-98dd-33a2f860c189 req-34299f6e-741e-4f0f-b9fc-5499f05c90ea service nova] Releasing lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:42 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully updated port: a3ce0364-2010-4551-8ac3-ecbde1899c57 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:15:43 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully updated port: ed7cd381-c2e7-4df2-a82b-adb0ab303211 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:15:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-changed-a3ce0364-2010-4551-8ac3-ecbde1899c57 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing instance network info cache due to event network-changed-a3ce0364-2010-4551-8ac3-ecbde1899c57. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:15:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] Acquiring lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] Acquired lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:43 user nova-compute[70709]: DEBUG nova.network.neutron [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing network info cache for port a3ce0364-2010-4551-8ac3-ecbde1899c57 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:15:43 user nova-compute[70709]: DEBUG nova.network.neutron [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:15:44 user nova-compute[70709]: DEBUG nova.network.neutron [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] Releasing lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-changed-ed7cd381-c2e7-4df2-a82b-adb0ab303211 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing instance network info cache due to event network-changed-ed7cd381-c2e7-4df2-a82b-adb0ab303211. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:15:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] Acquiring lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] Acquired lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:44 user nova-compute[70709]: DEBUG nova.network.neutron [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing network info cache for port ed7cd381-c2e7-4df2-a82b-adb0ab303211 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:15:44 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully updated port: 0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:15:44 user nova-compute[70709]: DEBUG nova.network.neutron [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:15:44 user nova-compute[70709]: DEBUG nova.network.neutron [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3337db4-e8b7-41f8-a7d2-5ef6baa56788 req-e08f61ae-4b11-4976-a417-fab4ff329c55 service nova] Releasing lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:45 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully updated port: 18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:15:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-changed-0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing instance network info cache due to event network-changed-0cce9851-cba8-4c4d-8094-8b2d6d513073. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:15:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] Acquiring lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] Acquired lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:45 user nova-compute[70709]: DEBUG nova.network.neutron [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing network info cache for port 0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:15:45 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully updated port: 90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:15:45 user nova-compute[70709]: DEBUG nova.network.neutron [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG nova.network.neutron [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] Releasing lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-changed-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing instance network info cache due to event network-changed-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] Acquiring lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] Acquired lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG nova.network.neutron [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing network info cache for port 18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG nova.network.neutron [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG nova.network.neutron [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2f9f74da-879b-4ee5-89ae-00d3706234f2 req-7969b262-6426-4eca-b661-604779eb0a9b service nova] Releasing lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Successfully updated port: 2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquired lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:15:46 user nova-compute[70709]: INFO nova.virt.block_device [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Booting with volume 5344d4e9-4ac7-4795-a6f9-86e054f9d4af at /dev/vdb
Jul 28 00:15:46 user nova-compute[70709]: DEBUG os_brick.utils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6ba1df-b45c-42cd-95c5-9bf3a44d02be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8f6455-e56a-4d90-b2d0-18f6e1cd75d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c663ce0-3846-4e37-99f6-d88677e3f662]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e31943-7eca-4846-a641-42c3a5752267]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:15:46 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:15:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86f30bf-940c-49c3-b22f-a85c95ff4bb6]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG os_brick.utils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:15:46 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating existing volume attachment record: 09a1c0dd-0330-4458-b24e-a885f8f72d73 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:15:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-changed-90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing instance network info cache due to event network-changed-90f98012-4803-4320-876d-05410ded4e63. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:15:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] Acquiring lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating instance_info_cache with network_info: [{"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Releasing lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Instance network_info: |[{"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] Acquired lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG nova.network.neutron [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing network info cache for port 90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG nova.network.neutron [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updated VIF entry in instance network info cache for port 90f98012-4803-4320-876d-05410ded4e63. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG nova.network.neutron [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating instance_info_cache with network_info: [{"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] Releasing lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-changed-2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing instance network info cache due to event network-changed-2815f7a8-335d-4450-b234-ae0ffea44ba1. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] Acquiring lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] Acquired lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:15:49 user nova-compute[70709]: DEBUG nova.network.neutron [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing network info cache for port 2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:15:50 user nova-compute[70709]: DEBUG nova.network.neutron [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updated VIF entry in instance network info cache for port 2815f7a8-335d-4450-b234-ae0ffea44ba1. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:15:50 user nova-compute[70709]: DEBUG nova.network.neutron [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating instance_info_cache with network_info: [{"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:15:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6b555f5-754b-4cc8-9833-68255589d6d8 req-4bdd16ca-31d1-4443-b327-1d2feeecaf74 service nova] Releasing lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:15:53 user nova-compute[70709]: INFO nova.virt.block_device [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Booting with volume 9fd57a0e-77fc-431a-8573-22b80adf48cb at /dev/vdc
Jul 28 00:15:53 user nova-compute[70709]: DEBUG os_brick.utils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[15452faf-0360-4483-bc32-f6bf07e13628]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdfaaa4-3846-42e3-9594-d517839e1b2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fdfebe-90b3-4562-b96f-7034286a716f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaf0de8-1e5a-4f26-a36c-35de2aa0554e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:15:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:15:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:15:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:15:54 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:15:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef95bcbb-2dbe-450a-a134-2dfd1f9a5a84]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:15:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:15:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:15:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:15:54 user nova-compute[70709]: DEBUG os_brick.utils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:15:54 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating existing volume attachment record: 294ba163-4463-462c-85e5-62e6260e1c0b {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:15:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:16:01 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Creating image(s)
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Ensure instance console log exists: /opt/stack/data/nova/instances/22b20888-013f-4130-a709-dd7d7932ad80/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Start _get_guest_xml network_info=[{"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'e21bac05-7d48-4c3f-9f73-d4e3da3cfa08', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfZpCxdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '22b20888-013f-4130-a709-dd7d7932ad80', 'attached_at': '', 'detached_at': '', 'volume_id': '9934460d-deb7-473b-aab3-fd4b53be4234', 'serial': '9934460d-deb7-473b-aab3-fd4b53be4234'}, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '09a1c0dd-0330-4458-b24e-a885f8f72d73', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSIQRJlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '22b20888-013f-4130-a709-dd7d7932ad80', 'attached_at': '', 'detached_at': '', 'volume_id': '5344d4e9-4ac7-4795-a6f9-86e054f9d4af', 'serial': '5344d4e9-4ac7-4795-a6f9-86e054f9d4af'}, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': '294ba163-4463-462c-85e5-62e6260e1c0b', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsYvTNIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '22b20888-013f-4130-a709-dd7d7932ad80', 'attached_at': '', 'detached_at': '', 'volume_id': '9fd57a0e-77fc-431a-8573-22b80adf48cb', 'serial': '9fd57a0e-77fc-431a-8573-22b80adf48cb'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:16:01 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:16:01 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connector [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Factory for ISCSI on None {{(pid=70709) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfZpCxdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:01 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:01 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:01 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d25b3-1da8-479f-8955-4f5a0b646ae4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:16:01 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe0d6fe-ddad-4427-a056-7c0220044dcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234] added
Jul 28 00:16:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3089b64f-acd8-45a2-afa1-0c77e7436311]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e3ce28-8b5d-48ce-8b95-f66a4616ecdd]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfZpCxdj {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfZpCxdj" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c73b91-79a7-4383-8f5d-9251834e07f2]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfZpCxdj'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded37d1e-d748-4463-bf84-17b59787eac6]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d555c7d7-c346-4afa-b2ca-4a1997aad33f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 28 00:16:01 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 28 00:16:01 user nova-compute[70709]:  {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:01 user nova-compute[70709]: WARNING os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 28 00:16:01 user nova-compute[70709]: 
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[205d019f-9495-4f80-a6ee-11c97434d433]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234, portal: 172.16.0.220,3260]
Jul 28 00:16:01 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234, portal: 172.16.0.220,3260] successful.
Jul 28 00:16:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb7b76b-3abb-4f5c-9a5b-23b46a2ddfdb]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db67b60-0a7b-45c7-9a54-0c34161335ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a675e404-e155-4152-8736-1f88c2dafa3b]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:16:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfZpCxdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '26539353166313437', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539353166313437', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSIQRJlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:02 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:02 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:02 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[349e7679-412b-4c70-acee-2f17b8e1a4bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:16:02 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ba0c7f-2e67-4b69-8f0a-d414752fb5cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af] added
Jul 28 00:16:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad916310-a7f7-4681-a139-8a9dfcf4f697]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76ea852-a6d9-448a-bb0f-50e635cc178a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSIQRJlA {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSIQRJlA" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9d97c7-e489-41b8-85ed-f8cf2e0910ac]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rSIQRJlA'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e18e48-e9f8-4e28-9f90-ed9b1e294d45]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad88e48f-5094-4beb-9031-44b0b91cb965]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffde2a1-ff22-48a7-9fee-ab7a036368f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af, portal: 172.16.0.220,3260]
Jul 28 00:16:02 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af, portal: 172.16.0.220,3260] successful.
Jul 28 00:16:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dcf1ab-5cfe-42bd-b6f5-9b3d350c5fd4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67ed52d-bee5-4bf9-8fcc-29dcb6d3f7cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:02 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:02 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d677418e-edb3-4984-9e78-6801744ac4f1]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:16:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSIQRJlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26530323939313438', 'path': '/dev/sdc'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530323939313438', 'path': '/dev/sdc'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsYvTNIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:03 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:03 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:03 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:16:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[59719fca-374e-4631-882f-323adee577e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:16:03 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d105a1-de87-4af2-a724-a0b87148adf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb] added
Jul 28 00:16:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edfdc7d-e658-42d9-8f55-9bdc6b14a5b1]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[66845667-aa61-407f-b8b6-e0298a5a1473]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsYvTNIW {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsYvTNIW" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa7c12c-ed87-4582-8a63-b8a2a2b528f3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KsYvTNIW'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffc50e5-7955-4607-a890-c0068aa667f1]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a3f141-a02b-469d-b583-f532fd3b8fa3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:04 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:04 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9ed996-7887-44d7-a349-c7b0d49970f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb, portal: 172.16.0.220,3260]
Jul 28 00:16:04 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb, portal: 172.16.0.220,3260] successful.
Jul 28 00:16:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc3c8cd-aa6a-40f6-9be1-3009de8fc29e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f9398b-87a2-41ff-ae45-8c141902d8fe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:04 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:04 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:04 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:04 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a07aae6-41d1-452e-ac96-4361439098d4]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:16:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsYvTNIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23231336335353931', 'path': '/dev/sdd'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231336335353931', 'path': '/dev/sdd'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c1:04,bridge_name='br-int',has_traffic_filtering=True,id=ba83c348-f5ee-4af0-96ff-6fd6af6d37ab,network=Network(fc210791-5d93-41c2-b8ce-4157852203a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba83c348-f5') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6f:2e,bridge_name='br-int',has_traffic_filtering=True,id=a3ce0364-2010-4551-8ac3-ecbde1899c57,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa3ce0364-20') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd381-c2e7-4df2-a82b-adb0ab303211,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped7cd381-c2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:9c:a0,bridge_name='br-int',has_traffic_filtering=True,id=0cce9851-cba8-4c4d-8094-8b2d6d513073,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cce9851-cb') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:e3:0f,bridge_name='br-int',has_traffic_filtering=True,id=18bfe0bf-52b4-4fa2-b716-de0a8acb27c0,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18bfe0bf-52') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:85:07,bridge_name='br-int',has_traffic_filtering=True,id=90f98012-4803-4320-876d-05410ded4e63,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f98012-48') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=2815f7a8-335d-4450-b234-ae0ffea44ba1,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2815f7a8-33') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lazy-loading 'pci_devices' on Instance uuid 22b20888-013f-4130-a709-dd7d7932ad80 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:16:05 user nova-compute[70709]:   <uuid>22b20888-013f-4130-a709-dd7d7932ad80</uuid>
Jul 28 00:16:05 user nova-compute[70709]:   <name>instance-0000000c</name>
Jul 28 00:16:05 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:16:05 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:16:05 user nova-compute[70709]:   <metadata>
Jul 28 00:16:05 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:16:05 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:16:05 user nova-compute[70709]:       <nova:name>tempest-device-tagging-server-1055112727</nova:name>
Jul 28 00:16:05 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:16:01</nova:creationTime>
Jul 28 00:16:05 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:16:05 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:16:05 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:16:05 user nova-compute[70709]:       <nova:owner>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:user uuid="b1313461455149229baa40380a1b9753">tempest-TaggedBootDevicesTest-619687507-project-member</nova:user>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:project uuid="0e1e74bcec444c19a7caccfec7a5495c">tempest-TaggedBootDevicesTest-619687507</nova:project>
Jul 28 00:16:05 user nova-compute[70709]:       </nova:owner>
Jul 28 00:16:05 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:16:05 user nova-compute[70709]:       <nova:ports>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:port uuid="ba83c348-f5ee-4af0-96ff-6fd6af6d37ab">
Jul 28 00:16:05 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 28 00:16:05 user nova-compute[70709]:         </nova:port>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:port uuid="a3ce0364-2010-4551-8ac3-ecbde1899c57">
Jul 28 00:16:05 user nova-compute[70709]:           <nova:ip type="fixed" address="10.1.1.35" ipVersion="4"/>
Jul 28 00:16:05 user nova-compute[70709]:         </nova:port>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:port uuid="ed7cd381-c2e7-4df2-a82b-adb0ab303211">
Jul 28 00:16:05 user nova-compute[70709]:           <nova:ip type="fixed" address="10.1.1.215" ipVersion="4"/>
Jul 28 00:16:05 user nova-compute[70709]:         </nova:port>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:port uuid="0cce9851-cba8-4c4d-8094-8b2d6d513073">
Jul 28 00:16:05 user nova-compute[70709]:           <nova:ip type="fixed" address="10.1.1.106" ipVersion="4"/>
Jul 28 00:16:05 user nova-compute[70709]:         </nova:port>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:port uuid="18bfe0bf-52b4-4fa2-b716-de0a8acb27c0">
Jul 28 00:16:05 user nova-compute[70709]:           <nova:ip type="fixed" address="10.1.1.80" ipVersion="4"/>
Jul 28 00:16:05 user nova-compute[70709]:         </nova:port>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:port uuid="90f98012-4803-4320-876d-05410ded4e63">
Jul 28 00:16:05 user nova-compute[70709]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 28 00:16:05 user nova-compute[70709]:         </nova:port>
Jul 28 00:16:05 user nova-compute[70709]:         <nova:port uuid="2815f7a8-335d-4450-b234-ae0ffea44ba1">
Jul 28 00:16:05 user nova-compute[70709]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 28 00:16:05 user nova-compute[70709]:         </nova:port>
Jul 28 00:16:05 user nova-compute[70709]:       </nova:ports>
Jul 28 00:16:05 user nova-compute[70709]:     </nova:instance>
Jul 28 00:16:05 user nova-compute[70709]:   </metadata>
Jul 28 00:16:05 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:16:05 user nova-compute[70709]:     <system>
Jul 28 00:16:05 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:16:05 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:16:05 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:16:05 user nova-compute[70709]:       <entry name="serial">22b20888-013f-4130-a709-dd7d7932ad80</entry>
Jul 28 00:16:05 user nova-compute[70709]:       <entry name="uuid">22b20888-013f-4130-a709-dd7d7932ad80</entry>
Jul 28 00:16:05 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:16:05 user nova-compute[70709]:     </system>
Jul 28 00:16:05 user nova-compute[70709]:   </sysinfo>
Jul 28 00:16:05 user nova-compute[70709]:   <os>
Jul 28 00:16:05 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:16:05 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:16:05 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:16:05 user nova-compute[70709]:   </os>
Jul 28 00:16:05 user nova-compute[70709]:   <features>
Jul 28 00:16:05 user nova-compute[70709]:     <acpi/>
Jul 28 00:16:05 user nova-compute[70709]:     <apic/>
Jul 28 00:16:05 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:16:05 user nova-compute[70709]:   </features>
Jul 28 00:16:05 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:16:05 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:16:05 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:16:05 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:16:05 user nova-compute[70709]:   </clock>
Jul 28 00:16:05 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:16:05 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:16:05 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:16:05 user nova-compute[70709]:   </cpu>
Jul 28 00:16:05 user nova-compute[70709]:   <devices>
Jul 28 00:16:05 user nova-compute[70709]:     <disk type="file" device="cdrom">
Jul 28 00:16:05 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none"/>
Jul 28 00:16:05 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/22b20888-013f-4130-a709-dd7d7932ad80/disk.config"/>
Jul 28 00:16:05 user nova-compute[70709]:       <target dev="hda" bus="ide"/>
Jul 28 00:16:05 user nova-compute[70709]:     </disk>
Jul 28 00:16:05 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:16:05 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:16:05 user nova-compute[70709]:       <source dev="/dev/sdb"/>
Jul 28 00:16:05 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:16:05 user nova-compute[70709]:       <serial>9934460d-deb7-473b-aab3-fd4b53be4234</serial>
Jul 28 00:16:05 user nova-compute[70709]:     </disk>
Jul 28 00:16:05 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:16:05 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:16:05 user nova-compute[70709]:       <source dev="/dev/sdc"/>
Jul 28 00:16:05 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:16:05 user nova-compute[70709]:       <serial>5344d4e9-4ac7-4795-a6f9-86e054f9d4af</serial>
Jul 28 00:16:05 user nova-compute[70709]:     </disk>
Jul 28 00:16:05 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:16:05 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:16:05 user nova-compute[70709]:       <source dev="/dev/sdd"/>
Jul 28 00:16:05 user nova-compute[70709]:       <target dev="vdc" bus="virtio"/>
Jul 28 00:16:05 user nova-compute[70709]:       <serial>9fd57a0e-77fc-431a-8573-22b80adf48cb</serial>
Jul 28 00:16:05 user nova-compute[70709]:     </disk>
Jul 28 00:16:05 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:16:05 user nova-compute[70709]:       <mac address="fa:16:3e:c0:c1:04"/>
Jul 28 00:16:05 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:16:05 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:16:05 user nova-compute[70709]:       <target dev="tapba83c348-f5"/>
Jul 28 00:16:05 user nova-compute[70709]:     </interface>
Jul 28 00:16:05 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:16:05 user nova-compute[70709]:       <mac address="fa:16:3e:d4:6f:2e"/>
Jul 28 00:16:05 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:16:05 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:16:05 user nova-compute[70709]:       <target dev="tapa3ce0364-20"/>
Jul 28 00:16:05 user nova-compute[70709]:     </interface>
Jul 28 00:16:05 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:16:05 user nova-compute[70709]:       <mac address="fa:16:3e:4e:c3:86"/>
Jul 28 00:16:05 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:16:05 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:16:05 user nova-compute[70709]:       <target dev="taped7cd381-c2"/>
Jul 28 00:16:05 user nova-compute[70709]:     </interface>
Jul 28 00:16:05 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:16:05 user nova-compute[70709]:       <mac address="fa:16:3e:ae:9c:a0"/>
Jul 28 00:16:05 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:16:05 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:16:05 user nova-compute[70709]:       <target dev="tap0cce9851-cb"/>
Jul 28 00:16:05 user nova-compute[70709]:     </interface>
Jul 28 00:16:05 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:16:05 user nova-compute[70709]:       <mac address="fa:16:3e:9e:e3:0f"/>
Jul 28 00:16:05 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:16:05 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:16:05 user nova-compute[70709]:       <target dev="tap18bfe0bf-52"/>
Jul 28 00:16:05 user nova-compute[70709]:     </interface>
Jul 28 00:16:05 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:16:05 user nova-compute[70709]:       <mac address="fa:16:3e:4b:85:07"/>
Jul 28 00:16:05 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:16:05 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:16:05 user nova-compute[70709]:       <target dev="tap90f98012-48"/>
Jul 28 00:16:05 user nova-compute[70709]:     </interface>
Jul 28 00:16:05 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:16:05 user nova-compute[70709]:       <mac address="fa:16:3e:a8:95:f5"/>
Jul 28 00:16:05 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:16:05 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:16:05 user nova-compute[70709]:       <target dev="tap2815f7a8-33"/>
Jul 28 00:16:05 user nova-compute[70709]:     </interface>
Jul 28 00:16:05 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:16:05 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/22b20888-013f-4130-a709-dd7d7932ad80/console.log" append="off"/>
Jul 28 00:16:05 user nova-compute[70709]:     </serial>
Jul 28 00:16:05 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:16:05 user nova-compute[70709]:     <video>
Jul 28 00:16:05 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:16:05 user nova-compute[70709]:     </video>
Jul 28 00:16:05 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:16:05 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:16:05 user nova-compute[70709]:     </rng>
Jul 28 00:16:05 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:16:05 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:16:05 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:16:05 user nova-compute[70709]:     </memballoon>
Jul 28 00:16:05 user nova-compute[70709]:   </devices>
Jul 28 00:16:05 user nova-compute[70709]: </domain>
Jul 28 00:16:05 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c1:04,bridge_name='br-int',has_traffic_filtering=True,id=ba83c348-f5ee-4af0-96ff-6fd6af6d37ab,network=Network(fc210791-5d93-41c2-b8ce-4157852203a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba83c348-f5') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c1:04,bridge_name='br-int',has_traffic_filtering=True,id=ba83c348-f5ee-4af0-96ff-6fd6af6d37ab,network=Network(fc210791-5d93-41c2-b8ce-4157852203a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba83c348-f5') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba83c348-f5, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba83c348-f5, col_values=(('external_ids', {'iface-id': 'ba83c348-f5ee-4af0-96ff-6fd6af6d37ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:c1:04', 'vm-uuid': '22b20888-013f-4130-a709-dd7d7932ad80'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: INFO os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c1:04,bridge_name='br-int',has_traffic_filtering=True,id=ba83c348-f5ee-4af0-96ff-6fd6af6d37ab,network=Network(fc210791-5d93-41c2-b8ce-4157852203a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba83c348-f5')
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6f:2e,bridge_name='br-int',has_traffic_filtering=True,id=a3ce0364-2010-4551-8ac3-ecbde1899c57,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa3ce0364-20') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6f:2e,bridge_name='br-int',has_traffic_filtering=True,id=a3ce0364-2010-4551-8ac3-ecbde1899c57,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa3ce0364-20') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3ce0364-20, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3ce0364-20, col_values=(('external_ids', {'iface-id': 'a3ce0364-2010-4551-8ac3-ecbde1899c57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:6f:2e', 'vm-uuid': '22b20888-013f-4130-a709-dd7d7932ad80'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: INFO os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6f:2e,bridge_name='br-int',has_traffic_filtering=True,id=a3ce0364-2010-4551-8ac3-ecbde1899c57,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa3ce0364-20')
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd381-c2e7-4df2-a82b-adb0ab303211,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped7cd381-c2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd381-c2e7-4df2-a82b-adb0ab303211,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped7cd381-c2') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped7cd381-c2, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped7cd381-c2, col_values=(('external_ids', {'iface-id': 'ed7cd381-c2e7-4df2-a82b-adb0ab303211', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:c3:86', 'vm-uuid': '22b20888-013f-4130-a709-dd7d7932ad80'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: INFO os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd381-c2e7-4df2-a82b-adb0ab303211,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped7cd381-c2')
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:9c:a0,bridge_name='br-int',has_traffic_filtering=True,id=0cce9851-cba8-4c4d-8094-8b2d6d513073,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cce9851-cb') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:9c:a0,bridge_name='br-int',has_traffic_filtering=True,id=0cce9851-cba8-4c4d-8094-8b2d6d513073,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cce9851-cb') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cce9851-cb, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0cce9851-cb, col_values=(('external_ids', {'iface-id': '0cce9851-cba8-4c4d-8094-8b2d6d513073', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:9c:a0', 'vm-uuid': '22b20888-013f-4130-a709-dd7d7932ad80'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: INFO os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:9c:a0,bridge_name='br-int',has_traffic_filtering=True,id=0cce9851-cba8-4c4d-8094-8b2d6d513073,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cce9851-cb')
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:e3:0f,bridge_name='br-int',has_traffic_filtering=True,id=18bfe0bf-52b4-4fa2-b716-de0a8acb27c0,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18bfe0bf-52') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:e3:0f,bridge_name='br-int',has_traffic_filtering=True,id=18bfe0bf-52b4-4fa2-b716-de0a8acb27c0,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18bfe0bf-52') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18bfe0bf-52, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18bfe0bf-52, col_values=(('external_ids', {'iface-id': '18bfe0bf-52b4-4fa2-b716-de0a8acb27c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:e3:0f', 'vm-uuid': '22b20888-013f-4130-a709-dd7d7932ad80'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: INFO os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:e3:0f,bridge_name='br-int',has_traffic_filtering=True,id=18bfe0bf-52b4-4fa2-b716-de0a8acb27c0,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18bfe0bf-52')
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:85:07,bridge_name='br-int',has_traffic_filtering=True,id=90f98012-4803-4320-876d-05410ded4e63,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f98012-48') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:85:07,bridge_name='br-int',has_traffic_filtering=True,id=90f98012-4803-4320-876d-05410ded4e63,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f98012-48') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90f98012-48, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90f98012-48, col_values=(('external_ids', {'iface-id': '90f98012-4803-4320-876d-05410ded4e63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:85:07', 'vm-uuid': '22b20888-013f-4130-a709-dd7d7932ad80'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: INFO os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:85:07,bridge_name='br-int',has_traffic_filtering=True,id=90f98012-4803-4320-876d-05410ded4e63,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f98012-48')
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=2815f7a8-335d-4450-b234-ae0ffea44ba1,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2815f7a8-33') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=2815f7a8-335d-4450-b234-ae0ffea44ba1,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2815f7a8-33') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2815f7a8-33, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2815f7a8-33, col_values=(('external_ids', {'iface-id': '2815f7a8-335d-4450-b234-ae0ffea44ba1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:95:f5', 'vm-uuid': '22b20888-013f-4130-a709-dd7d7932ad80'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:05 user nova-compute[70709]: INFO os_vif [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=2815f7a8-335d-4450-b234-ae0ffea44ba1,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2815f7a8-33')
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] No BDM found with device name hda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] No VIF found with MAC fa:16:3e:c0:c1:04, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] No VIF found with MAC fa:16:3e:9e:e3:0f, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:16:05 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Using config drive
Jul 28 00:16:05 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Creating config drive at /opt/stack/data/nova/instances/22b20888-013f-4130-a709-dd7d7932ad80/disk.config
Jul 28 00:16:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/22b20888-013f-4130-a709-dd7d7932ad80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnr0r8ikv {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/22b20888-013f-4130-a709-dd7d7932ad80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnr0r8ikv" returned: 0 in 0.057s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-fa0eab1c-0529-4cc9-bb64-4283de7c67f4 req-b30842d8-83f4-4225-8829-0855615f27c4 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fa0eab1c-0529-4cc9-bb64-4283de7c67f4 req-b30842d8-83f4-4225-8829-0855615f27c4 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fa0eab1c-0529-4cc9-bb64-4283de7c67f4 req-b30842d8-83f4-4225-8829-0855615f27c4 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fa0eab1c-0529-4cc9-bb64-4283de7c67f4 req-b30842d8-83f4-4225-8829-0855615f27c4 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-fa0eab1c-0529-4cc9-bb64-4283de7c67f4 req-b30842d8-83f4-4225-8829-0855615f27c4 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:07 user nova-compute[70709]: WARNING nova.compute.manager [req-fa0eab1c-0529-4cc9-bb64-4283de7c67f4 req-b30842d8-83f4-4225-8829-0855615f27c4 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab for instance with vm_state building and task_state spawning.
Jul 28 00:16:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-3ff1ebf4-4ae4-4a00-9efc-2d648081983a req-9f3df416-c8c6-455b-88d5-38bd8d08aacb service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3ff1ebf4-4ae4-4a00-9efc-2d648081983a req-9f3df416-c8c6-455b-88d5-38bd8d08aacb service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3ff1ebf4-4ae4-4a00-9efc-2d648081983a req-9f3df416-c8c6-455b-88d5-38bd8d08aacb service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3ff1ebf4-4ae4-4a00-9efc-2d648081983a req-9f3df416-c8c6-455b-88d5-38bd8d08aacb service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-3ff1ebf4-4ae4-4a00-9efc-2d648081983a req-9f3df416-c8c6-455b-88d5-38bd8d08aacb service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:07 user nova-compute[70709]: WARNING nova.compute.manager [req-3ff1ebf4-4ae4-4a00-9efc-2d648081983a req-9f3df416-c8c6-455b-88d5-38bd8d08aacb service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 for instance with vm_state building and task_state spawning.
Jul 28 00:16:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-efe0caf4-2c51-4f46-9a05-fb84d993815d req-05067376-dc92-42a3-9644-389256a624ad service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-efe0caf4-2c51-4f46-9a05-fb84d993815d req-05067376-dc92-42a3-9644-389256a624ad service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-efe0caf4-2c51-4f46-9a05-fb84d993815d req-05067376-dc92-42a3-9644-389256a624ad service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-efe0caf4-2c51-4f46-9a05-fb84d993815d req-05067376-dc92-42a3-9644-389256a624ad service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-efe0caf4-2c51-4f46-9a05-fb84d993815d req-05067376-dc92-42a3-9644-389256a624ad service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:08 user nova-compute[70709]: WARNING nova.compute.manager [req-efe0caf4-2c51-4f46-9a05-fb84d993815d req-05067376-dc92-42a3-9644-389256a624ad service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 for instance with vm_state building and task_state spawning.
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:09 user nova-compute[70709]: WARNING nova.compute.manager [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab for instance with vm_state building and task_state spawning.
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:09 user nova-compute[70709]: WARNING nova.compute.manager [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 for instance with vm_state building and task_state spawning.
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:09 user nova-compute[70709]: WARNING nova.compute.manager [req-1ea78285-2eb3-4597-9247-f75abcf0be8d req-e1220697-49cb-4fa1-855c-d1ae5a1225d5 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 for instance with vm_state building and task_state spawning.
Jul 28 00:16:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:09 user nova-compute[70709]: WARNING nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 for instance with vm_state building and task_state spawning.
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:09 user nova-compute[70709]: WARNING nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 for instance with vm_state building and task_state spawning.
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:09 user nova-compute[70709]: WARNING nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 for instance with vm_state building and task_state spawning.
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:09 user nova-compute[70709]: WARNING nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 for instance with vm_state building and task_state spawning.
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:09 user nova-compute[70709]: WARNING nova.compute.manager [req-8bb9a4a3-b885-44c8-89e7-ed2c201712a3 req-ace5ae9c-5435-4b88-a1bd-23fcb1c92183 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 for instance with vm_state building and task_state spawning.
Jul 28 00:16:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:10 user nova-compute[70709]: WARNING nova.compute.manager [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 for instance with vm_state building and task_state spawning.
Jul 28 00:16:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:10 user nova-compute[70709]: WARNING nova.compute.manager [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-90f98012-4803-4320-876d-05410ded4e63 for instance with vm_state building and task_state spawning.
Jul 28 00:16:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:10 user nova-compute[70709]: WARNING nova.compute.manager [req-98641486-330a-4e77-a388-9bfdb4c80c93 req-d9039be5-4ab1-472e-a143-782b33383294 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-90f98012-4803-4320-876d-05410ded4e63 for instance with vm_state building and task_state spawning.
Jul 28 00:16:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:10 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updating instance_info_cache with network_info: [{"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503371.4190223, 22b20888-013f-4130-a709-dd7d7932ad80 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:16:11 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] VM Resumed (Lifecycle Event)
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:16:11 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Instance spawned successfully.
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:11 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503371.420986, 22b20888-013f-4130-a709-dd7d7932ad80 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:16:11 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] VM Started (Lifecycle Event)
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:16:11 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:16:11 user nova-compute[70709]: INFO nova.compute.manager [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Took 10.33 seconds to spawn the instance on the hypervisor.
Jul 28 00:16:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:11 user nova-compute[70709]: INFO nova.compute.manager [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Took 35.13 seconds to build instance.
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe66e40-1e29-44c7-a3c9-185f9a872b79 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "22b20888-013f-4130-a709-dd7d7932ad80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.238s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "d007829f-9716-4aac-aaa5-e2c9becbe299" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lazy-loading 'flavor' on Instance uuid d007829f-9716-4aac-aaa5-e2c9becbe299 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.178s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "d007829f-9716-4aac-aaa5-e2c9becbe299" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:12 user nova-compute[70709]: INFO nova.compute.manager [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Attaching volume abbab141-53e2-4fac-bd2d-7668b0a864ba to /dev/vdb
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG os_brick.utils [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a7e1ca-989a-4fdb-9302-39503f061cf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f80d1e0-7cc6-4f20-b47c-2cad7e6ca6c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[083e45d2-8807-415e-a975-e03ad225e843]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0130cb-725f-4e9b-b585-5fe08141dc62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:13 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e2c316-abf7-41ce-8319-5d1a62d4febf]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG os_brick.utils [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Updating existing volume attachment record: 482f38de-1629-4ef8-a89c-84de44a6e8bc {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:15 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:16:15 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=6577MB free_disk=25.56713104248047GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance d007829f-9716-4aac-aaa5-e2c9becbe299 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance df55bbd3-31ab-42f8-9a71-4ed8e3c4428c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance fadc10cd-bf2a-445f-8d0b-450cbed8fb8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4789522e-1b10-41d7-9332-649b5aaf5270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 169813c4-7d36-4660-b2fa-4a27fe3e8c86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 7cb91b91-a2ec-4baf-bffe-e83aafd26a02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 22b20888-013f-4130-a709-dd7d7932ad80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:16:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.639s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-8ce2e51a-6c85-4005-8a2a-95e45a616fd3 req-15a7199d-19a4-4c4f-807d-8d53a1451209 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-changed-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-8ce2e51a-6c85-4005-8a2a-95e45a616fd3 req-15a7199d-19a4-4c4f-807d-8d53a1451209 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Refreshing instance network info cache due to event network-changed-7e92340f-f93d-411f-8e69-2a75164b3679. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8ce2e51a-6c85-4005-8a2a-95e45a616fd3 req-15a7199d-19a4-4c4f-807d-8d53a1451209 service nova] Acquiring lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8ce2e51a-6c85-4005-8a2a-95e45a616fd3 req-15a7199d-19a4-4c4f-807d-8d53a1451209 service nova] Acquired lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG nova.network.neutron [req-8ce2e51a-6c85-4005-8a2a-95e45a616fd3 req-15a7199d-19a4-4c4f-807d-8d53a1451209 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Refreshing network info cache for port 7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-2a09d270-1ec5-49c5-b02f-de66e0580967 req-a143004c-f79d-4310-ba34-10c36e00ece3 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-changed-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-2a09d270-1ec5-49c5-b02f-de66e0580967 req-a143004c-f79d-4310-ba34-10c36e00ece3 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Refreshing instance network info cache due to event network-changed-ff3e21e0-da08-4f60-a9fb-e1a4ea572467. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2a09d270-1ec5-49c5-b02f-de66e0580967 req-a143004c-f79d-4310-ba34-10c36e00ece3 service nova] Acquiring lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2a09d270-1ec5-49c5-b02f-de66e0580967 req-a143004c-f79d-4310-ba34-10c36e00ece3 service nova] Acquired lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG nova.network.neutron [req-2a09d270-1ec5-49c5-b02f-de66e0580967 req-a143004c-f79d-4310-ba34-10c36e00ece3 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Refreshing network info cache for port ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:16:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:16 user nova-compute[70709]: INFO nova.compute.manager [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] instance snapshotting
Jul 28 00:16:17 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Beginning live snapshot process
Jul 28 00:16:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json -f qcow2 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-a15875e6-da06-45fa-9951-4dcd84100ce3 req-08c29520-7045-42a6-99ec-c0c963023691 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-changed-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-a15875e6-da06-45fa-9951-4dcd84100ce3 req-08c29520-7045-42a6-99ec-c0c963023691 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Refreshing instance network info cache due to event network-changed-ee9a657a-7c7d-4849-8394-9438487032f9. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a15875e6-da06-45fa-9951-4dcd84100ce3 req-08c29520-7045-42a6-99ec-c0c963023691 service nova] Acquiring lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a15875e6-da06-45fa-9951-4dcd84100ce3 req-08c29520-7045-42a6-99ec-c0c963023691 service nova] Acquired lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG nova.network.neutron [req-a15875e6-da06-45fa-9951-4dcd84100ce3 req-08c29520-7045-42a6-99ec-c0c963023691 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Refreshing network info cache for port ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG nova.network.neutron [req-2a09d270-1ec5-49c5-b02f-de66e0580967 req-a143004c-f79d-4310-ba34-10c36e00ece3 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updated VIF entry in instance network info cache for port ff3e21e0-da08-4f60-a9fb-e1a4ea572467. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG nova.network.neutron [req-2a09d270-1ec5-49c5-b02f-de66e0580967 req-a143004c-f79d-4310-ba34-10c36e00ece3 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updating instance_info_cache with network_info: [{"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json -f qcow2" returned: 0 in 0.406s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json -f qcow2 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2a09d270-1ec5-49c5-b02f-de66e0580967 req-a143004c-f79d-4310-ba34-10c36e00ece3 service nova] Releasing lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpibxhbew2/a2b8804902144fb191d63a428068d0ff.delta 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:18 user nova-compute[70709]: DEBUG nova.network.neutron [req-8ce2e51a-6c85-4005-8a2a-95e45a616fd3 req-15a7199d-19a4-4c4f-807d-8d53a1451209 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updated VIF entry in instance network info cache for port 7e92340f-f93d-411f-8e69-2a75164b3679. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:16:18 user nova-compute[70709]: DEBUG nova.network.neutron [req-8ce2e51a-6c85-4005-8a2a-95e45a616fd3 req-15a7199d-19a4-4c4f-807d-8d53a1451209 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating instance_info_cache with network_info: [{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpibxhbew2/a2b8804902144fb191d63a428068d0ff.delta 1073741824" returned: 0 in 0.060s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 28 00:16:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Checking UEFI support for host arch (x86_64) {{(pid=70709) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 28 00:16:18 user nova-compute[70709]: INFO nova.virt.libvirt.host [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] UEFI support detected
Jul 28 00:16:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8ce2e51a-6c85-4005-8a2a-95e45a616fd3 req-15a7199d-19a4-4c4f-807d-8d53a1451209 service nova] Releasing lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:16:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:16:18 user nova-compute[70709]: DEBUG nova.network.neutron [req-a15875e6-da06-45fa-9951-4dcd84100ce3 req-08c29520-7045-42a6-99ec-c0c963023691 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updated VIF entry in instance network info cache for port ee9a657a-7c7d-4849-8394-9438487032f9. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:16:18 user nova-compute[70709]: DEBUG nova.network.neutron [req-a15875e6-da06-45fa-9951-4dcd84100ce3 req-08c29520-7045-42a6-99ec-c0c963023691 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updating instance_info_cache with network_info: [{"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a15875e6-da06-45fa-9951-4dcd84100ce3 req-08c29520-7045-42a6-99ec-c0c963023691 service nova] Releasing lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] COPY block job progress, current cursor: 458752 final cursor: 75497472 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:16:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-ed0f7c7c-8225-4afa-ba29-8a611182954d req-371eb2ab-bcca-4796-8afd-332291170a39 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Received event network-changed-98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-ed0f7c7c-8225-4afa-ba29-8a611182954d req-371eb2ab-bcca-4796-8afd-332291170a39 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Refreshing instance network info cache due to event network-changed-98291a12-0469-487a-8016-155a23415be0. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:16:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ed0f7c7c-8225-4afa-ba29-8a611182954d req-371eb2ab-bcca-4796-8afd-332291170a39 service nova] Acquiring lock "refresh_cache-25c6e8f8-d23d-4ec9-932b-df0471d3e41b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ed0f7c7c-8225-4afa-ba29-8a611182954d req-371eb2ab-bcca-4796-8afd-332291170a39 service nova] Acquired lock "refresh_cache-25c6e8f8-d23d-4ec9-932b-df0471d3e41b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:19 user nova-compute[70709]: DEBUG nova.network.neutron [req-ed0f7c7c-8225-4afa-ba29-8a611182954d req-371eb2ab-bcca-4796-8afd-332291170a39 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Refreshing network info cache for port 98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:16:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:16:19 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 28 00:16:19 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:16:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpibxhbew2/a2b8804902144fb191d63a428068d0ff.delta /opt/stack/data/nova/instances/snapshots/tmpibxhbew2/a2b8804902144fb191d63a428068d0ff {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:19 user nova-compute[70709]: DEBUG nova.network.neutron [req-ed0f7c7c-8225-4afa-ba29-8a611182954d req-371eb2ab-bcca-4796-8afd-332291170a39 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Updated VIF entry in instance network info cache for port 98291a12-0469-487a-8016-155a23415be0. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:16:19 user nova-compute[70709]: DEBUG nova.network.neutron [req-ed0f7c7c-8225-4afa-ba29-8a611182954d req-371eb2ab-bcca-4796-8afd-332291170a39 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Updating instance_info_cache with network_info: [{"id": "98291a12-0469-487a-8016-155a23415be0", "address": "fa:16:3e:d5:5f:d5", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98291a12-04", "ovs_interfaceid": "98291a12-0469-487a-8016-155a23415be0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ed0f7c7c-8225-4afa-ba29-8a611182954d req-371eb2ab-bcca-4796-8afd-332291170a39 service nova] Releasing lock "refresh_cache-25c6e8f8-d23d-4ec9-932b-df0471d3e41b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpibxhbew2/a2b8804902144fb191d63a428068d0ff.delta /opt/stack/data/nova/instances/snapshots/tmpibxhbew2/a2b8804902144fb191d63a428068d0ff" returned: 0 in 0.372s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:19 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Snapshot extracted, beginning image upload
Jul 28 00:16:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:16:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bZXNotva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:20 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:20 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:21 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[66af43e3-7f1a-498a-a88b-d4bb3ce2af2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:16:21 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8fd572-f0b3-4f37-9b38-eda11506c534]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba] added
Jul 28 00:16:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61cfb87-ff17-4907-9618-8427cdde4338]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.069s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[00049940-af4c-4a4f-bcbe-e42a2c32da32]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG nova.objects.instance [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bZXNotva {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bZXNotva" returned: 0 in 0.035s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[43454844-b049-4065-8887-d81c26717f7e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bZXNotva'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8126e38-1faa-4fb1-a418-a9dc779ec1b8]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e73c1a-0d03-4778-ac72-a12c42f72583]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:21 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:21 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:21 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:21 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[739859e3-dd8d-4c29-851e-0813cad4ab51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba, portal: 172.16.0.220,3260]
Jul 28 00:16:21 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba, portal: 172.16.0.220,3260] successful.
Jul 28 00:16:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:21 user nova-compute[70709]: INFO nova.compute.manager [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Attaching volume d16451a8-1aa5-4c9d-9856-f1f0de94a874 to /dev/vdb
Jul 28 00:16:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c350ee-afbc-4bb9-b842-1d80b0f1eddd]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e7300e-c4ac-4b7d-a8bd-eeff7e85a77d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:21 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:21 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:21 user nova-compute[70709]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba (non-flash)
Jul 28 00:16:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:21 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:21 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:21 user nova-compute[70709]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba (non-flash)
Jul 28 00:16:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.utils [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[545e6836-3d88-41ba-b62b-c9f0fbb53920]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bZXNotva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9e7fbf-e18b-49c1-ba49-7a31ecaad8b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fefadf3-6b79-4e62-b1a3-f38f8b355463]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[987de23f-7453-470d-9c59-b2bb527d3283]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0803f8b-21a6-4360-94b7-47d154063425]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:21 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:16:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9319f09-2738-40b0-b39c-472ecfb5dfa7]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG os_brick.utils [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:21 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updating existing volume attachment record: dc1ae311-8d5a-4130-b0b8-eb8006768bc4 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG nova.compute.manager [req-be380444-7851-4da4-a7d3-7cbefeafc15d req-03ac6cda-b494-48a2-a246-e0ea65bfa885 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-changed-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG nova.compute.manager [req-be380444-7851-4da4-a7d3-7cbefeafc15d req-03ac6cda-b494-48a2-a246-e0ea65bfa885 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Refreshing instance network info cache due to event network-changed-84dc7a3e-6f63-4ff1-8689-38f607df3ae6. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be380444-7851-4da4-a7d3-7cbefeafc15d req-03ac6cda-b494-48a2-a246-e0ea65bfa885 service nova] Acquiring lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be380444-7851-4da4-a7d3-7cbefeafc15d req-03ac6cda-b494-48a2-a246-e0ea65bfa885 service nova] Acquired lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG nova.network.neutron [req-be380444-7851-4da4-a7d3-7cbefeafc15d req-03ac6cda-b494-48a2-a246-e0ea65bfa885 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Refreshing network info cache for port 84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] <== connect_volume: return (1498ms) {'type': 'block', 'scsi_wwn': '23532353531616562', 'path': '/dev/sde'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532353531616562', 'path': '/dev/sde'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG nova.objects.instance [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lazy-loading 'flavor' on Instance uuid d007829f-9716-4aac-aaa5-e2c9becbe299 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG nova.network.neutron [req-be380444-7851-4da4-a7d3-7cbefeafc15d req-03ac6cda-b494-48a2-a246-e0ea65bfa885 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updated VIF entry in instance network info cache for port 84dc7a3e-6f63-4ff1-8689-38f607df3ae6. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG nova.network.neutron [req-be380444-7851-4da4-a7d3-7cbefeafc15d req-03ac6cda-b494-48a2-a246-e0ea65bfa885 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updating instance_info_cache with network_info: [{"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:16:22 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:16:22 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:16:22 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:16:22 user nova-compute[70709]:   <serial>abbab141-53e2-4fac-bd2d-7668b0a864ba</serial>
Jul 28 00:16:22 user nova-compute[70709]: </disk>
Jul 28 00:16:22 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:16:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be380444-7851-4da4-a7d3-7cbefeafc15d req-03ac6cda-b494-48a2-a246-e0ea65bfa885 service nova] Releasing lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:22 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Snapshot image upload complete
Jul 28 00:16:22 user nova-compute[70709]: INFO nova.compute.manager [None req-2e384c48-0cf4-4616-a3c6-04289a934072 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Took 5.73 seconds to snapshot the instance on the hypervisor.
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'flavor' on Instance uuid 25c6e8f8-d23d-4ec9-932b-df0471d3e41b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:23 user nova-compute[70709]: INFO nova.compute.manager [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] instance snapshotting
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:23 user nova-compute[70709]: INFO nova.compute.manager [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Attaching volume 6fa349e4-d68d-4414-a0da-bc1507a050f5 to /dev/vdb
Jul 28 00:16:23 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Beginning live snapshot process
Jul 28 00:16:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] No VIF found with MAC fa:16:3e:b6:d0:a1, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG os_brick.utils [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0a2dbd-f4ca-4d8a-acb6-7b2312d2748f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.048s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6d0c82-bf5f-4228-b043-8205cfa218ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2a9012-b6b8-4549-8d8d-11718bbb4752]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[19504354-ee92-4e18-8212-c792c2fbee18]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json -f qcow2 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:23 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fc7d31-1207-491a-a339-9dbf53ca4c29]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG os_brick.utils [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Updating existing volume attachment record: 029a1ffa-fc78-4bd6-ab48-b75fa813f1ed {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dc0d7ac7-849b-4f8b-9a84-09931d07bc42 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.623s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json -f qcow2" returned: 0 in 0.244s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json -f qcow2 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "d007829f-9716-4aac-aaa5-e2c9becbe299" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:23 user nova-compute[70709]: INFO nova.compute.manager [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Terminating instance
Jul 28 00:16:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoqqtmf25/2e419ce972a84306b4a691423b500b18.delta 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoqqtmf25/2e419ce972a84306b4a691423b500b18.delta 1073741824" returned: 0 in 0.062s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:24 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 28 00:16:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG nova.compute.manager [req-972bf38c-c28d-40d2-ac3c-5b51ab94633f req-e47abd40-d379-4ff6-b597-bf5fdb7da217 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Received event network-vif-unplugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-972bf38c-c28d-40d2-ac3c-5b51ab94633f req-e47abd40-d379-4ff6-b597-bf5fdb7da217 service nova] Acquiring lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-972bf38c-c28d-40d2-ac3c-5b51ab94633f req-e47abd40-d379-4ff6-b597-bf5fdb7da217 service nova] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-972bf38c-c28d-40d2-ac3c-5b51ab94633f req-e47abd40-d379-4ff6-b597-bf5fdb7da217 service nova] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG nova.compute.manager [req-972bf38c-c28d-40d2-ac3c-5b51ab94633f req-e47abd40-d379-4ff6-b597-bf5fdb7da217 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] No waiting events found dispatching network-vif-unplugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG nova.compute.manager [req-972bf38c-c28d-40d2-ac3c-5b51ab94633f req-e47abd40-d379-4ff6-b597-bf5fdb7da217 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Received event network-vif-unplugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:16:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:16:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Instance destroyed successfully.
Jul 28 00:16:25 user nova-compute[70709]: DEBUG nova.objects.instance [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lazy-loading 'resources' on Instance uuid d007829f-9716-4aac-aaa5-e2c9becbe299 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1262383189',display_name='tempest-DeleteServersTestJSON-server-1262383189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1262383189',id=1,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eef809cb1ad7477cb6cbeb995587a1e2',ramdisk_id='',reservation_id='r-ietafv9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-680948539',owner_user_name='tempest-DeleteServersTestJSON-680948539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:14:33Z,user_data=None,user_id='82c95ea8cd91475692bb9394d9d34e5d',uuid=d007829f-9716-4aac-aaa5-e2c9becbe299,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "address": "fa:16:3e:b6:d0:a1", "network": {"id": "04b1db21-ffaa-4b59-853c-c32f011c1e4a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431996065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eef809cb1ad7477cb6cbeb995587a1e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ac23ce-a2", "ovs_interfaceid": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Converting VIF {"id": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "address": "fa:16:3e:b6:d0:a1", "network": {"id": "04b1db21-ffaa-4b59-853c-c32f011c1e4a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431996065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eef809cb1ad7477cb6cbeb995587a1e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ac23ce-a2", "ovs_interfaceid": "21ac23ce-a2fe-4bee-99a9-bba9bd8fd718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d0:a1,bridge_name='br-int',has_traffic_filtering=True,id=21ac23ce-a2fe-4bee-99a9-bba9bd8fd718,network=Network(04b1db21-ffaa-4b59-853c-c32f011c1e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ac23ce-a2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_vif [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d0:a1,bridge_name='br-int',has_traffic_filtering=True,id=21ac23ce-a2fe-4bee-99a9-bba9bd8fd718,network=Network(04b1db21-ffaa-4b59-853c-c32f011c1e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ac23ce-a2') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21ac23ce-a2, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:25 user nova-compute[70709]: INFO os_vif [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d0:a1,bridge_name='br-int',has_traffic_filtering=True,id=21ac23ce-a2fe-4bee-99a9-bba9bd8fd718,network=Network(04b1db21-ffaa-4b59-853c-c32f011c1e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ac23ce-a2')
Jul 28 00:16:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bZXNotva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:25 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[129a5214-4c1c-46aa-b495-f2de25fd1315]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:16:25 user nova-compute[70709]: No targets found.
Jul 28 00:16:25 user nova-compute[70709]: iSNS:
Jul 28 00:16:25 user nova-compute[70709]: No targets found.
Jul 28 00:16:25 user nova-compute[70709]: STATIC:
Jul 28 00:16:25 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234
Jul 28 00:16:25 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:16:25 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:16:25 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba
Jul 28 00:16:25 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:16:25 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:16:25 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af
Jul 28 00:16:25 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:16:25 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:16:25 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb
Jul 28 00:16:25 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:16:25 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:16:25 user nova-compute[70709]: FIRMWARE:
Jul 28 00:16:25 user nova-compute[70709]: No targets found.
Jul 28 00:16:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:16:25 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:16:25 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99f0166-b46f-40a9-987f-de9302095b53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b977ff71-1767-4f47-a52f-5057aa125d68]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:25 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:25 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:25 user nova-compute[70709]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba (non-flash)
Jul 28 00:16:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:25 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:25 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:25 user nova-compute[70709]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba (non-flash)
Jul 28 00:16:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b9ba8f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba'): ({'sde'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Removing single pathed devices sde {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dbc63b-c6b3-447c-849f-cf1f4ef41b59]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8424aa36-38d2-40e6-b514-68c3364ac770]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Flushing IO for device /dev/sde {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d679ed-9de9-47bc-9a18-89a9319b5f20]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7bad0e-b135-4a38-8d76-4b6a51795c55]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoqqtmf25/2e419ce972a84306b4a691423b500b18.delta /opt/stack/data/nova/instances/snapshots/tmpoqqtmf25/2e419ce972a84306b4a691423b500b18 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[420189e3-2c1c-4a42-8f04-84428beb1c7c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e165650-001a-4fbe-9130-5b131409cf5b]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba, portal: 172.16.0.220,3260]
Jul 28 00:16:25 user nova-compute[70709]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba, portal: 172.16.0.220,3260] successful.
Jul 28 00:16:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbab141-53e2-4fac-bd2d-7668b0a864ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb72a79-bb86-42df-8283-4b60505d89ca]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] <== disconnect_volume: return (348ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:16:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Deleting instance files /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299_del
Jul 28 00:16:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Deletion of /opt/stack/data/nova/instances/d007829f-9716-4aac-aaa5-e2c9becbe299_del complete
Jul 28 00:16:25 user nova-compute[70709]: INFO nova.compute.manager [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Took 1.83 seconds to destroy the instance on the hypervisor.
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:16:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoqqtmf25/2e419ce972a84306b4a691423b500b18.delta /opt/stack/data/nova/instances/snapshots/tmpoqqtmf25/2e419ce972a84306b4a691423b500b18" returned: 0 in 0.284s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Snapshot extracted, beginning image upload
Jul 28 00:16:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:26 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:26 user nova-compute[70709]: DEBUG nova.compute.manager [req-167338a3-c93d-452f-8335-45efd82eef4a req-2954ab2d-f247-4c6f-932f-abd2cd5580d4 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Received event network-vif-plugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-167338a3-c93d-452f-8335-45efd82eef4a req-2954ab2d-f247-4c6f-932f-abd2cd5580d4 service nova] Acquiring lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-167338a3-c93d-452f-8335-45efd82eef4a req-2954ab2d-f247-4c6f-932f-abd2cd5580d4 service nova] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-167338a3-c93d-452f-8335-45efd82eef4a req-2954ab2d-f247-4c6f-932f-abd2cd5580d4 service nova] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:26 user nova-compute[70709]: DEBUG nova.compute.manager [req-167338a3-c93d-452f-8335-45efd82eef4a req-2954ab2d-f247-4c6f-932f-abd2cd5580d4 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] No waiting events found dispatching network-vif-plugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:26 user nova-compute[70709]: WARNING nova.compute.manager [req-167338a3-c93d-452f-8335-45efd82eef4a req-2954ab2d-f247-4c6f-932f-abd2cd5580d4 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Received unexpected event network-vif-plugged-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 for instance with vm_state active and task_state deleting.
Jul 28 00:16:26 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Took 0.64 seconds to deallocate network for instance.
Jul 28 00:16:26 user nova-compute[70709]: DEBUG nova.compute.manager [req-f2e7d74a-2e2c-4fd6-b4df-987d8f2ef252 req-d1e0630d-ecd7-4306-9f83-ce0e2d08a452 service nova] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Received event network-vif-deleted-21ac23ce-a2fe-4bee-99a9-bba9bd8fd718 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:27 user nova-compute[70709]: INFO nova.compute.manager [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Took 0.96 seconds to detach 1 volumes for instance.
Jul 28 00:16:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:27 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:16:27 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:16:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:28 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Deleted allocations for instance d007829f-9716-4aac-aaa5-e2c9becbe299
Jul 28 00:16:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-88981e64-4a96-4dde-bb8d-58641a798c08 tempest-DeleteServersTestJSON-680948539 tempest-DeleteServersTestJSON-680948539-project-member] Lock "d007829f-9716-4aac-aaa5-e2c9becbe299" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.180s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:28 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Snapshot image upload complete
Jul 28 00:16:28 user nova-compute[70709]: INFO nova.compute.manager [None req-d73a69b9-df05-4351-82a2-320ec148dc64 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Took 5.57 seconds to snapshot the instance on the hypervisor.
Jul 28 00:16:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnkLoDVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:29 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:29 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:29 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a3bae6-ec10-498f-b390-f89b65501c5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:16:29 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f07b81-72c1-4e65-a8e7-61dfc35ab42e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874] added
Jul 28 00:16:29 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74df455-cdca-4432-8805-f4e434ba053f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3068b2-5a8d-41ea-932c-06a505e9cc62]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnkLoDVE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnkLoDVE" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[214794e3-f2b2-413e-b352-af66c354baed]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UnkLoDVE'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9120163e-1c85-4c09-bf36-c46e426e7d2d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fb22ad-cef1-4fc9-8534-9a97e1dfb5b4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:29 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:29 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:29 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:29 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:29 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:29 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc2c274-9d86-419c-8245-eac6bb7ff74e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260]
Jul 28 00:16:29 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260] successful.
Jul 28 00:16:29 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9218f86-75b4-4792-bf4d-e62de2baf508]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24e19bc-2635-4c23-b59a-29e155f9f293]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:30 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:30 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:30 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:30 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:30 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:30 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:30 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:30 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6d1b17-5e4b-477b-9fa8-465d45d2e7db]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:16:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnkLoDVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26661633630346136', 'path': '/dev/sde'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661633630346136', 'path': '/dev/sde'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG nova.objects.instance [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:16:31 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:16:31 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:16:31 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:16:31 user nova-compute[70709]:   <serial>d16451a8-1aa5-4c9d-9856-f1f0de94a874</serial>
Jul 28 00:16:31 user nova-compute[70709]: </disk>
Jul 28 00:16:31 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTkxsNLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:31 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:31 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:31 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3176e43a-d895-4dac-b6d0-20978a287fbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:16:31 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8df90a-5b5d-4513-8155-1e687a627bc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5] added
Jul 28 00:16:31 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5014972d-0221-4a6f-a02e-894df9d91f3a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8429bcfd-e99e-40e0-b7a4-f74071812c7d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTkxsNLI {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTkxsNLI" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c0ecca-aed1-4e1a-ac2c-5259187c9a77]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZTkxsNLI'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5ca748-bf0e-4b05-8637-eec20a9f5378]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[579a8d52-cb53-4a50-8667-642e4d1e5729]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:31 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:31 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No VIF found with MAC fa:16:3e:65:2d:ef, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc0302c-aef3-437f-a744-8cc2f335b441]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5, portal: 172.16.0.220,3260]
Jul 28 00:16:31 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5, portal: 172.16.0.220,3260] successful.
Jul 28 00:16:31 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1634db78-0cb5-45a0-aac2-3201da7129d3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed7b44e-7a23-4d4f-959d-6a71e0f93ba9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:16:31 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:31 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:16:31 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f49c34d6-678f-48fd-b22f-4e9d5d21c691 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.258s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e7ae57-416c-490c-b8b1-28288936a5b5]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTkxsNLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4ce79852-9413-48ca-a546-974e70bd2583 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4ce79852-9413-48ca-a546-974e70bd2583 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4ce79852-9413-48ca-a546-974e70bd2583 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4ce79852-9413-48ca-a546-974e70bd2583 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70709) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG nova.objects.instance [None req-4ce79852-9413-48ca-a546-974e70bd2583 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-577b9aad-1674-49f7-8e1a-0caa0a456a24 req-84ccbf94-cf13-47dd-a48c-7dfc2e2a5780 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-unplugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-577b9aad-1674-49f7-8e1a-0caa0a456a24 req-84ccbf94-cf13-47dd-a48c-7dfc2e2a5780 service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-577b9aad-1674-49f7-8e1a-0caa0a456a24 req-84ccbf94-cf13-47dd-a48c-7dfc2e2a5780 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-577b9aad-1674-49f7-8e1a-0caa0a456a24 req-84ccbf94-cf13-47dd-a48c-7dfc2e2a5780 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-577b9aad-1674-49f7-8e1a-0caa0a456a24 req-84ccbf94-cf13-47dd-a48c-7dfc2e2a5780 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-unplugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:32 user nova-compute[70709]: WARNING nova.compute.manager [req-577b9aad-1674-49f7-8e1a-0caa0a456a24 req-84ccbf94-cf13-47dd-a48c-7dfc2e2a5780 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received unexpected event network-vif-unplugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with vm_state active and task_state powering-off.
Jul 28 00:16:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23464343338633964', 'path': '/dev/sdf'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464343338633964', 'path': '/dev/sdf'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'flavor' on Instance uuid 25c6e8f8-d23d-4ec9-932b-df0471d3e41b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:16:32 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:16:32 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:16:32 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:16:32 user nova-compute[70709]:   <serial>6fa349e4-d68d-4414-a0da-bc1507a050f5</serial>
Jul 28 00:16:32 user nova-compute[70709]: </disk>
Jul 28 00:16:32 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:16:33 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance destroyed successfully.
Jul 28 00:16:33 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4ce79852-9413-48ca-a546-974e70bd2583 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No VIF found with MAC fa:16:3e:d5:5f:d5, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:16:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4ce79852-9413-48ca-a546-974e70bd2583 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.140s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8854cfbd-54c9-4748-943f-807232c4b242 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.953s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:34 user nova-compute[70709]: DEBUG nova.compute.manager [req-db6c5112-531f-44fc-96b8-0563dd6c5a23 req-ad554a31-8f52-4e6a-9304-1fd2ab41785e service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-db6c5112-531f-44fc-96b8-0563dd6c5a23 req-ad554a31-8f52-4e6a-9304-1fd2ab41785e service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-db6c5112-531f-44fc-96b8-0563dd6c5a23 req-ad554a31-8f52-4e6a-9304-1fd2ab41785e service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-db6c5112-531f-44fc-96b8-0563dd6c5a23 req-ad554a31-8f52-4e6a-9304-1fd2ab41785e service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:34 user nova-compute[70709]: DEBUG nova.compute.manager [req-db6c5112-531f-44fc-96b8-0563dd6c5a23 req-ad554a31-8f52-4e6a-9304-1fd2ab41785e service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:34 user nova-compute[70709]: WARNING nova.compute.manager [req-db6c5112-531f-44fc-96b8-0563dd6c5a23 req-ad554a31-8f52-4e6a-9304-1fd2ab41785e service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received unexpected event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with vm_state stopped and task_state None.
Jul 28 00:16:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:36 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:16:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:16:36 user nova-compute[70709]: INFO nova.compute.claims [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Claim successful on node user
Jul 28 00:16:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:36 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:16:36 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:16:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:36 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:16:37 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.policy [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8557f7232a94f76982b8840c534a6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05b559855734f9e9b221ec954881ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:16:37 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Creating image(s)
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "/opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "/opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "/opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk 1073741824" returned: 0 in 0.046s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.127s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Successfully created port: aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Cannot resize image /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'migration_context' on Instance uuid 3139de03-95b1-4e8a-a15a-886dbd9cfb56 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Ensure instance console log exists: /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Successfully updated port: aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:16:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "refresh_cache-3139de03-95b1-4e8a-a15a-886dbd9cfb56" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquired lock "refresh_cache-3139de03-95b1-4e8a-a15a-886dbd9cfb56" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:16:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-8a4bb585-f89d-4334-9711-d9b9b04c2e10 req-52d974f9-78a4-4ab5-9a3d-12fd3340667e service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Received event network-changed-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-8a4bb585-f89d-4334-9711-d9b9b04c2e10 req-52d974f9-78a4-4ab5-9a3d-12fd3340667e service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Refreshing instance network info cache due to event network-changed-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:16:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8a4bb585-f89d-4334-9711-d9b9b04c2e10 req-52d974f9-78a4-4ab5-9a3d-12fd3340667e service nova] Acquiring lock "refresh_cache-3139de03-95b1-4e8a-a15a-886dbd9cfb56" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Updating instance_info_cache with network_info: [{"id": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "address": "fa:16:3e:58:8f:1f", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7bedab-d7", "ovs_interfaceid": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Releasing lock "refresh_cache-3139de03-95b1-4e8a-a15a-886dbd9cfb56" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Instance network_info: |[{"id": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "address": "fa:16:3e:58:8f:1f", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7bedab-d7", "ovs_interfaceid": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8a4bb585-f89d-4334-9711-d9b9b04c2e10 req-52d974f9-78a4-4ab5-9a3d-12fd3340667e service nova] Acquired lock "refresh_cache-3139de03-95b1-4e8a-a15a-886dbd9cfb56" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.network.neutron [req-8a4bb585-f89d-4334-9711-d9b9b04c2e10 req-52d974f9-78a4-4ab5-9a3d-12fd3340667e service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Refreshing network info cache for port aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Start _get_guest_xml network_info=[{"id": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "address": "fa:16:3e:58:8f:1f", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7bedab-d7", "ovs_interfaceid": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:16:39 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:16:39 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-345403129',display_name='tempest-AttachVolumeNegativeTest-server-345403129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-345403129',id=13,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6a2zm4+M9iYAIdeIe6RFMvAvFr+Ckru9lv1wBCxg54rtRuDdEhir0CtK9VwFoOB4jhQDERgAPaqdgQuuGoRX9qafll38RhXx/pBLQZPjSattuPXD6/HetDtK+dZ1Jckg==',key_name='tempest-keypair-1279532060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-sbfam4zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:16:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=3139de03-95b1-4e8a-a15a-886dbd9cfb56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "address": "fa:16:3e:58:8f:1f", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7bedab-d7", "ovs_interfaceid": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "address": "fa:16:3e:58:8f:1f", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7bedab-d7", "ovs_interfaceid": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:8f:1f,bridge_name='br-int',has_traffic_filtering=True,id=aa7bedab-d716-4bf6-9cf0-5f3f40b2b950,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7bedab-d7') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'pci_devices' on Instance uuid 3139de03-95b1-4e8a-a15a-886dbd9cfb56 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:16:39 user nova-compute[70709]:   <uuid>3139de03-95b1-4e8a-a15a-886dbd9cfb56</uuid>
Jul 28 00:16:39 user nova-compute[70709]:   <name>instance-0000000d</name>
Jul 28 00:16:39 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:16:39 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:16:39 user nova-compute[70709]:   <metadata>
Jul 28 00:16:39 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:16:39 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:16:39 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeNegativeTest-server-345403129</nova:name>
Jul 28 00:16:39 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:16:39</nova:creationTime>
Jul 28 00:16:39 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:16:39 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:16:39 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:16:39 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:16:39 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:16:39 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:16:39 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:16:39 user nova-compute[70709]:       <nova:owner>
Jul 28 00:16:39 user nova-compute[70709]:         <nova:user uuid="d8557f7232a94f76982b8840c534a6d4">tempest-AttachVolumeNegativeTest-337281402-project-member</nova:user>
Jul 28 00:16:39 user nova-compute[70709]:         <nova:project uuid="e05b559855734f9e9b221ec954881ccd">tempest-AttachVolumeNegativeTest-337281402</nova:project>
Jul 28 00:16:39 user nova-compute[70709]:       </nova:owner>
Jul 28 00:16:39 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:16:39 user nova-compute[70709]:       <nova:ports>
Jul 28 00:16:39 user nova-compute[70709]:         <nova:port uuid="aa7bedab-d716-4bf6-9cf0-5f3f40b2b950">
Jul 28 00:16:39 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 28 00:16:39 user nova-compute[70709]:         </nova:port>
Jul 28 00:16:39 user nova-compute[70709]:       </nova:ports>
Jul 28 00:16:39 user nova-compute[70709]:     </nova:instance>
Jul 28 00:16:39 user nova-compute[70709]:   </metadata>
Jul 28 00:16:39 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:16:39 user nova-compute[70709]:     <system>
Jul 28 00:16:39 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:16:39 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:16:39 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:16:39 user nova-compute[70709]:       <entry name="serial">3139de03-95b1-4e8a-a15a-886dbd9cfb56</entry>
Jul 28 00:16:39 user nova-compute[70709]:       <entry name="uuid">3139de03-95b1-4e8a-a15a-886dbd9cfb56</entry>
Jul 28 00:16:39 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:16:39 user nova-compute[70709]:     </system>
Jul 28 00:16:39 user nova-compute[70709]:   </sysinfo>
Jul 28 00:16:39 user nova-compute[70709]:   <os>
Jul 28 00:16:39 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:16:39 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:16:39 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:16:39 user nova-compute[70709]:   </os>
Jul 28 00:16:39 user nova-compute[70709]:   <features>
Jul 28 00:16:39 user nova-compute[70709]:     <acpi/>
Jul 28 00:16:39 user nova-compute[70709]:     <apic/>
Jul 28 00:16:39 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:16:39 user nova-compute[70709]:   </features>
Jul 28 00:16:39 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:16:39 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:16:39 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:16:39 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:16:39 user nova-compute[70709]:   </clock>
Jul 28 00:16:39 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:16:39 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:16:39 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:16:39 user nova-compute[70709]:   </cpu>
Jul 28 00:16:39 user nova-compute[70709]:   <devices>
Jul 28 00:16:39 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:16:39 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:16:39 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk"/>
Jul 28 00:16:39 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:16:39 user nova-compute[70709]:     </disk>
Jul 28 00:16:39 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:16:39 user nova-compute[70709]:       <mac address="fa:16:3e:58:8f:1f"/>
Jul 28 00:16:39 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:16:39 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:16:39 user nova-compute[70709]:       <target dev="tapaa7bedab-d7"/>
Jul 28 00:16:39 user nova-compute[70709]:     </interface>
Jul 28 00:16:39 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:16:39 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/console.log" append="off"/>
Jul 28 00:16:39 user nova-compute[70709]:     </serial>
Jul 28 00:16:39 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:16:39 user nova-compute[70709]:     <video>
Jul 28 00:16:39 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:16:39 user nova-compute[70709]:     </video>
Jul 28 00:16:39 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:16:39 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:16:39 user nova-compute[70709]:     </rng>
Jul 28 00:16:39 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:16:39 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:16:39 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:16:39 user nova-compute[70709]:     </memballoon>
Jul 28 00:16:39 user nova-compute[70709]:   </devices>
Jul 28 00:16:39 user nova-compute[70709]: </domain>
Jul 28 00:16:39 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-345403129',display_name='tempest-AttachVolumeNegativeTest-server-345403129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-345403129',id=13,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6a2zm4+M9iYAIdeIe6RFMvAvFr+Ckru9lv1wBCxg54rtRuDdEhir0CtK9VwFoOB4jhQDERgAPaqdgQuuGoRX9qafll38RhXx/pBLQZPjSattuPXD6/HetDtK+dZ1Jckg==',key_name='tempest-keypair-1279532060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-sbfam4zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:16:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=3139de03-95b1-4e8a-a15a-886dbd9cfb56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "address": "fa:16:3e:58:8f:1f", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7bedab-d7", "ovs_interfaceid": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "address": "fa:16:3e:58:8f:1f", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7bedab-d7", "ovs_interfaceid": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:8f:1f,bridge_name='br-int',has_traffic_filtering=True,id=aa7bedab-d716-4bf6-9cf0-5f3f40b2b950,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7bedab-d7') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG os_vif [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:8f:1f,bridge_name='br-int',has_traffic_filtering=True,id=aa7bedab-d716-4bf6-9cf0-5f3f40b2b950,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7bedab-d7') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa7bedab-d7, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa7bedab-d7, col_values=(('external_ids', {'iface-id': 'aa7bedab-d716-4bf6-9cf0-5f3f40b2b950', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:8f:1f', 'vm-uuid': '3139de03-95b1-4e8a-a15a-886dbd9cfb56'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:39 user nova-compute[70709]: INFO os_vif [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:8f:1f,bridge_name='br-int',has_traffic_filtering=True,id=aa7bedab-d716-4bf6-9cf0-5f3f40b2b950,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7bedab-d7')
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No VIF found with MAC fa:16:3e:58:8f:1f, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.network.neutron [req-8a4bb585-f89d-4334-9711-d9b9b04c2e10 req-52d974f9-78a4-4ab5-9a3d-12fd3340667e service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Updated VIF entry in instance network info cache for port aa7bedab-d716-4bf6-9cf0-5f3f40b2b950. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG nova.network.neutron [req-8a4bb585-f89d-4334-9711-d9b9b04c2e10 req-52d974f9-78a4-4ab5-9a3d-12fd3340667e service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Updating instance_info_cache with network_info: [{"id": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "address": "fa:16:3e:58:8f:1f", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7bedab-d7", "ovs_interfaceid": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8a4bb585-f89d-4334-9711-d9b9b04c2e10 req-52d974f9-78a4-4ab5-9a3d-12fd3340667e service nova] Releasing lock "refresh_cache-3139de03-95b1-4e8a-a15a-886dbd9cfb56" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:40 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503385.2895644, d007829f-9716-4aac-aaa5-e2c9becbe299 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:16:40 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] VM Stopped (Lifecycle Event)
Jul 28 00:16:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-78f0e0e7-adf4-4eac-a002-268f558611b2 None None] [instance: d007829f-9716-4aac-aaa5-e2c9becbe299] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:40 user nova-compute[70709]: DEBUG nova.compute.manager [req-d7a1dd3d-47c5-4940-86e9-31ab01d4399e req-03062fda-14ff-4053-9842-1bbce7157687 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Received event network-vif-plugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d7a1dd3d-47c5-4940-86e9-31ab01d4399e req-03062fda-14ff-4053-9842-1bbce7157687 service nova] Acquiring lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d7a1dd3d-47c5-4940-86e9-31ab01d4399e req-03062fda-14ff-4053-9842-1bbce7157687 service nova] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d7a1dd3d-47c5-4940-86e9-31ab01d4399e req-03062fda-14ff-4053-9842-1bbce7157687 service nova] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:40 user nova-compute[70709]: DEBUG nova.compute.manager [req-d7a1dd3d-47c5-4940-86e9-31ab01d4399e req-03062fda-14ff-4053-9842-1bbce7157687 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] No waiting events found dispatching network-vif-plugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:40 user nova-compute[70709]: WARNING nova.compute.manager [req-d7a1dd3d-47c5-4940-86e9-31ab01d4399e req-03062fda-14ff-4053-9842-1bbce7157687 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Received unexpected event network-vif-plugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 for instance with vm_state building and task_state spawning.
Jul 28 00:16:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503402.6789281, 3139de03-95b1-4e8a-a15a-886dbd9cfb56 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:16:42 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] VM Resumed (Lifecycle Event)
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:16:42 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Instance spawned successfully.
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:16:42 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503402.6800807, 3139de03-95b1-4e8a-a15a-886dbd9cfb56 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:16:42 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] VM Started (Lifecycle Event)
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:16:42 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:16:42 user nova-compute[70709]: INFO nova.compute.manager [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Took 5.60 seconds to spawn the instance on the hypervisor.
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-7f73c059-b381-4746-919c-ccf06b53c136 req-a2bad521-3eef-4980-8579-301c68ba1097 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Received event network-vif-plugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7f73c059-b381-4746-919c-ccf06b53c136 req-a2bad521-3eef-4980-8579-301c68ba1097 service nova] Acquiring lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7f73c059-b381-4746-919c-ccf06b53c136 req-a2bad521-3eef-4980-8579-301c68ba1097 service nova] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7f73c059-b381-4746-919c-ccf06b53c136 req-a2bad521-3eef-4980-8579-301c68ba1097 service nova] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-7f73c059-b381-4746-919c-ccf06b53c136 req-a2bad521-3eef-4980-8579-301c68ba1097 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] No waiting events found dispatching network-vif-plugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:42 user nova-compute[70709]: WARNING nova.compute.manager [req-7f73c059-b381-4746-919c-ccf06b53c136 req-a2bad521-3eef-4980-8579-301c68ba1097 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Received unexpected event network-vif-plugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 for instance with vm_state building and task_state spawning.
Jul 28 00:16:42 user nova-compute[70709]: INFO nova.compute.manager [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Took 6.51 seconds to build instance.
Jul 28 00:16:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61e9349-3c5a-40f0-bdda-a5c5b0930f07 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.597s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-a1b17e03-a898-412e-a6c3-f05bb5359dfb req-c846180b-6378-43fd-9424-4508244a6595 service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Received event network-changed-2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-a1b17e03-a898-412e-a6c3-f05bb5359dfb req-c846180b-6378-43fd-9424-4508244a6595 service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Refreshing instance network info cache due to event network-changed-2c14e4aa-47f7-4638-9571-de623dacdd7b. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:16:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a1b17e03-a898-412e-a6c3-f05bb5359dfb req-c846180b-6378-43fd-9424-4508244a6595 service nova] Acquiring lock "refresh_cache-fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a1b17e03-a898-412e-a6c3-f05bb5359dfb req-c846180b-6378-43fd-9424-4508244a6595 service nova] Acquired lock "refresh_cache-fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:45 user nova-compute[70709]: DEBUG nova.network.neutron [req-a1b17e03-a898-412e-a6c3-f05bb5359dfb req-c846180b-6378-43fd-9424-4508244a6595 service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Refreshing network info cache for port 2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:16:45 user nova-compute[70709]: DEBUG nova.network.neutron [req-a1b17e03-a898-412e-a6c3-f05bb5359dfb req-c846180b-6378-43fd-9424-4508244a6595 service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Updated VIF entry in instance network info cache for port 2c14e4aa-47f7-4638-9571-de623dacdd7b. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:16:45 user nova-compute[70709]: DEBUG nova.network.neutron [req-a1b17e03-a898-412e-a6c3-f05bb5359dfb req-c846180b-6378-43fd-9424-4508244a6595 service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Updating instance_info_cache with network_info: [{"id": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "address": "fa:16:3e:b7:2f:37", "network": {"id": "227b7608-fa54-48a0-b970-0387ef09b50f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1366593134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822cbb8b476c43f1a9fa2d932d9625ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c14e4aa-47", "ovs_interfaceid": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a1b17e03-a898-412e-a6c3-f05bb5359dfb req-c846180b-6378-43fd-9424-4508244a6595 service nova] Releasing lock "refresh_cache-fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-81c5fde5-3991-469e-bcba-8433caff0335 req-07eb27e5-3080-433d-9f66-9f304e637448 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-changed-3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-81c5fde5-3991-469e-bcba-8433caff0335 req-07eb27e5-3080-433d-9f66-9f304e637448 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Refreshing instance network info cache due to event network-changed-3a29154a-ca72-43a4-a111-81c2ac1be6f7. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:16:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-81c5fde5-3991-469e-bcba-8433caff0335 req-07eb27e5-3080-433d-9f66-9f304e637448 service nova] Acquiring lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-81c5fde5-3991-469e-bcba-8433caff0335 req-07eb27e5-3080-433d-9f66-9f304e637448 service nova] Acquired lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:47 user nova-compute[70709]: DEBUG nova.network.neutron [req-81c5fde5-3991-469e-bcba-8433caff0335 req-07eb27e5-3080-433d-9f66-9f304e637448 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Refreshing network info cache for port 3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503393.067396, 2bb828f4-bb7d-4754-bcaa-38f2954b8eee => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:16:48 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] VM Stopped (Lifecycle Event)
Jul 28 00:16:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-86cc7c4d-9388-417b-bdac-8aae4e741cb1 None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-86cc7c4d-9388-417b-bdac-8aae4e741cb1 None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "interface-4789522e-1b10-41d7-9332-649b5aaf5270-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "interface-4789522e-1b10-41d7-9332-649b5aaf5270-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG nova.objects.instance [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lazy-loading 'flavor' on Instance uuid 4789522e-1b10-41d7-9332-649b5aaf5270 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG nova.objects.instance [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lazy-loading 'pci_requests' on Instance uuid 4789522e-1b10-41d7-9332-649b5aaf5270 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG nova.network.neutron [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG nova.policy [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fbbbdee1153489ca8062e2dbf4dc5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428557cbe58946ccb2e7afd4bc9c233f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG nova.network.neutron [req-81c5fde5-3991-469e-bcba-8433caff0335 req-07eb27e5-3080-433d-9f66-9f304e637448 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updated VIF entry in instance network info cache for port 3a29154a-ca72-43a4-a111-81c2ac1be6f7. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG nova.network.neutron [req-81c5fde5-3991-469e-bcba-8433caff0335 req-07eb27e5-3080-433d-9f66-9f304e637448 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updating instance_info_cache with network_info: [{"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-81c5fde5-3991-469e-bcba-8433caff0335 req-07eb27e5-3080-433d-9f66-9f304e637448 service nova] Releasing lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG nova.objects.instance [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lazy-loading 'flavor' on Instance uuid fadc10cd-bf2a-445f-8d0b-450cbed8fb8b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:49 user nova-compute[70709]: INFO nova.compute.manager [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Attaching volume 80a6ffad-a922-42e0-8dba-b898853f52e0 to /dev/sdc
Jul 28 00:16:49 user nova-compute[70709]: DEBUG nova.network.neutron [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Successfully created port: f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG os_brick.utils [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[db924daa-2c86-4580-b3a8-213bce03364b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4434255f-8ac8-4991-b9a2-5b6707016b33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0179a38d-96d7-4c17-a6bc-c8b49adcc191]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cd4938-5508-4b1a-9adf-29c7e00b492a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:49 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b85d33-e8d8-470d-98fb-2b103cd9f786]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG os_brick.utils [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Updating existing volume attachment record: 759b5bdd-0940-4201-a99f-294af5d5ecc4 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG nova.objects.instance [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lazy-loading 'flavor' on Instance uuid 169813c4-7d36-4660-b2fa-4a27fe3e8c86 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-1a3dea89-d3b9-4ba4-8ad0-c2e3de533f5a req-047af026-b668-4c25-8cce-065f6fa6a16b service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Received event network-changed-49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-1a3dea89-d3b9-4ba4-8ad0-c2e3de533f5a req-047af026-b668-4c25-8cce-065f6fa6a16b service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Refreshing instance network info cache due to event network-changed-49c52655-67de-4f51-ba7d-0ba30b5b137d. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1a3dea89-d3b9-4ba4-8ad0-c2e3de533f5a req-047af026-b668-4c25-8cce-065f6fa6a16b service nova] Acquiring lock "refresh_cache-169813c4-7d36-4660-b2fa-4a27fe3e8c86" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1a3dea89-d3b9-4ba4-8ad0-c2e3de533f5a req-047af026-b668-4c25-8cce-065f6fa6a16b service nova] Acquired lock "refresh_cache-169813c4-7d36-4660-b2fa-4a27fe3e8c86" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG nova.network.neutron [req-1a3dea89-d3b9-4ba4-8ad0-c2e3de533f5a req-047af026-b668-4c25-8cce-065f6fa6a16b service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Refreshing network info cache for port 49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:49 user nova-compute[70709]: INFO nova.compute.manager [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Attaching volume bd65011d-6aaf-416a-8cd6-9c2f5238a562 to /dev/vdb
Jul 28 00:16:50 user nova-compute[70709]: DEBUG os_brick.utils [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3125276f-54b4-458a-9fd5-78c23941770f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[84543a44-da00-4774-ac16-37b65f52f91d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4009b9b9-04d5-41ca-9b03-5275f25bf978]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b47bb8-7aa4-4157-9a7e-7a63b00934f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:50 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[be76d772-5dc7-4d18-878e-1ea2ea004988]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG os_brick.utils [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Updating existing volume attachment record: 547ad336-2abe-4db5-b9a2-96c4867d585b {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.network.neutron [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Successfully updated port: f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquired lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.network.neutron [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-a7bdb0da-a4c0-4f5f-8d29-247ecee9d71b req-31318bb2-5b29-4acd-a0b3-5653aea8360e service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-changed-f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-a7bdb0da-a4c0-4f5f-8d29-247ecee9d71b req-31318bb2-5b29-4acd-a0b3-5653aea8360e service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Refreshing instance network info cache due to event network-changed-f13d9ff3-8b48-48f6-9a03-28c9f491d05f. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a7bdb0da-a4c0-4f5f-8d29-247ecee9d71b req-31318bb2-5b29-4acd-a0b3-5653aea8360e service nova] Acquiring lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.network.neutron [req-1a3dea89-d3b9-4ba4-8ad0-c2e3de533f5a req-047af026-b668-4c25-8cce-065f6fa6a16b service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Updated VIF entry in instance network info cache for port 49c52655-67de-4f51-ba7d-0ba30b5b137d. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.network.neutron [req-1a3dea89-d3b9-4ba4-8ad0-c2e3de533f5a req-047af026-b668-4c25-8cce-065f6fa6a16b service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Updating instance_info_cache with network_info: [{"id": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "address": "fa:16:3e:2b:ad:e1", "network": {"id": "6c016c68-c5f7-4d34-8635-a8a459fb21cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1698481621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6125c0be794d138836e1315bfcbb09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c52655-67", "ovs_interfaceid": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1a3dea89-d3b9-4ba4-8ad0-c2e3de533f5a req-047af026-b668-4c25-8cce-065f6fa6a16b service nova] Releasing lock "refresh_cache-169813c4-7d36-4660-b2fa-4a27fe3e8c86" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.network.neutron [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updating instance_info_cache with network_info: [{"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "address": "fa:16:3e:a1:93:d2", "network": {"id": "23b485f5-cc59-4a7e-8bfc-d0bded63ce99", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-959400954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13d9ff3-8b", "ovs_interfaceid": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Releasing lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a7bdb0da-a4c0-4f5f-8d29-247ecee9d71b req-31318bb2-5b29-4acd-a0b3-5653aea8360e service nova] Acquired lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.network.neutron [req-a7bdb0da-a4c0-4f5f-8d29-247ecee9d71b req-31318bb2-5b29-4acd-a0b3-5653aea8360e service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Refreshing network info cache for port f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-330796388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-330796388',id=9,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoBYj2u47hm72HhPB+cTlKzbBr01X98haFYfPWO+EXKwci2MxT+ZwG+mgNy/3QVDHnu7QwR0/IxM01QqzXGpS0obA/XwoFe0OALm1jPCLHs+e/CkiKFa7ONMv9sWpS8gg==',key_name='tempest-keypair-409851532',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:15:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='428557cbe58946ccb2e7afd4bc9c233f',ramdisk_id='',reservation_id='r-6gkdaj2k',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1986096815',owner_user_name='tempest-TaggedAttachmentsTest-1986096815-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fbbbdee1153489ca8062e2dbf4dc5df',uuid=4789522e-1b10-41d7-9332-649b5aaf5270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "address": "fa:16:3e:a1:93:d2", "network": {"id": "23b485f5-cc59-4a7e-8bfc-d0bded63ce99", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-959400954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13d9ff3-8b", "ovs_interfaceid": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converting VIF {"id": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "address": "fa:16:3e:a1:93:d2", "network": {"id": "23b485f5-cc59-4a7e-8bfc-d0bded63ce99", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-959400954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13d9ff3-8b", "ovs_interfaceid": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=f13d9ff3-8b48-48f6-9a03-28c9f491d05f,network=Network(23b485f5-cc59-4a7e-8bfc-d0bded63ce99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13d9ff3-8b') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG os_vif [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=f13d9ff3-8b48-48f6-9a03-28c9f491d05f,network=Network(23b485f5-cc59-4a7e-8bfc-d0bded63ce99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13d9ff3-8b') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf13d9ff3-8b, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf13d9ff3-8b, col_values=(('external_ids', {'iface-id': 'f13d9ff3-8b48-48f6-9a03-28c9f491d05f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:93:d2', 'vm-uuid': '4789522e-1b10-41d7-9332-649b5aaf5270'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:50 user nova-compute[70709]: INFO os_vif [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=f13d9ff3-8b48-48f6-9a03-28c9f491d05f,network=Network(23b485f5-cc59-4a7e-8bfc-d0bded63ce99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13d9ff3-8b')
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-330796388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-330796388',id=9,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoBYj2u47hm72HhPB+cTlKzbBr01X98haFYfPWO+EXKwci2MxT+ZwG+mgNy/3QVDHnu7QwR0/IxM01QqzXGpS0obA/XwoFe0OALm1jPCLHs+e/CkiKFa7ONMv9sWpS8gg==',key_name='tempest-keypair-409851532',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:15:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='428557cbe58946ccb2e7afd4bc9c233f',ramdisk_id='',reservation_id='r-6gkdaj2k',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1986096815',owner_user_name='tempest-TaggedAttachmentsTest-1986096815-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fbbbdee1153489ca8062e2dbf4dc5df',uuid=4789522e-1b10-41d7-9332-649b5aaf5270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "address": "fa:16:3e:a1:93:d2", "network": {"id": "23b485f5-cc59-4a7e-8bfc-d0bded63ce99", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-959400954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13d9ff3-8b", "ovs_interfaceid": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converting VIF {"id": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "address": "fa:16:3e:a1:93:d2", "network": {"id": "23b485f5-cc59-4a7e-8bfc-d0bded63ce99", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-959400954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13d9ff3-8b", "ovs_interfaceid": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=f13d9ff3-8b48-48f6-9a03-28c9f491d05f,network=Network(23b485f5-cc59-4a7e-8bfc-d0bded63ce99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13d9ff3-8b') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:16:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] attach device xml: <interface type="ethernet">
Jul 28 00:16:50 user nova-compute[70709]:   <mac address="fa:16:3e:a1:93:d2"/>
Jul 28 00:16:50 user nova-compute[70709]:   <model type="virtio"/>
Jul 28 00:16:50 user nova-compute[70709]:   <mtu size="1442"/>
Jul 28 00:16:50 user nova-compute[70709]:   <target dev="tapf13d9ff3-8b"/>
Jul 28 00:16:50 user nova-compute[70709]: </interface>
Jul 28 00:16:50 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] No BDM found with device name hda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] No VIF found with MAC fa:16:3e:44:03:ee, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:16:51 user nova-compute[70709]:   <nova:package version="0.0.0"/>
Jul 28 00:16:51 user nova-compute[70709]:   <nova:name>tempest-device-tagging-server-330796388</nova:name>
Jul 28 00:16:51 user nova-compute[70709]:   <nova:creationTime>2023-07-28 00:16:51</nova:creationTime>
Jul 28 00:16:51 user nova-compute[70709]:   <nova:flavor name="m1.tiny">
Jul 28 00:16:51 user nova-compute[70709]:     <nova:memory>512</nova:memory>
Jul 28 00:16:51 user nova-compute[70709]:     <nova:disk>1</nova:disk>
Jul 28 00:16:51 user nova-compute[70709]:     <nova:swap>0</nova:swap>
Jul 28 00:16:51 user nova-compute[70709]:     <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:16:51 user nova-compute[70709]:     <nova:vcpus>1</nova:vcpus>
Jul 28 00:16:51 user nova-compute[70709]:   </nova:flavor>
Jul 28 00:16:51 user nova-compute[70709]:   <nova:owner>
Jul 28 00:16:51 user nova-compute[70709]:     <nova:user uuid="5fbbbdee1153489ca8062e2dbf4dc5df">tempest-TaggedAttachmentsTest-1986096815-project-member</nova:user>
Jul 28 00:16:51 user nova-compute[70709]:     <nova:project uuid="428557cbe58946ccb2e7afd4bc9c233f">tempest-TaggedAttachmentsTest-1986096815</nova:project>
Jul 28 00:16:51 user nova-compute[70709]:   </nova:owner>
Jul 28 00:16:51 user nova-compute[70709]:   <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:16:51 user nova-compute[70709]:   <nova:ports>
Jul 28 00:16:51 user nova-compute[70709]:     <nova:port uuid="3a29154a-ca72-43a4-a111-81c2ac1be6f7">
Jul 28 00:16:51 user nova-compute[70709]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 28 00:16:51 user nova-compute[70709]:     </nova:port>
Jul 28 00:16:51 user nova-compute[70709]:     <nova:port uuid="f13d9ff3-8b48-48f6-9a03-28c9f491d05f">
Jul 28 00:16:51 user nova-compute[70709]:       <nova:ip type="fixed" address="10.10.10.26" ipVersion="4"/>
Jul 28 00:16:51 user nova-compute[70709]:     </nova:port>
Jul 28 00:16:51 user nova-compute[70709]:   </nova:ports>
Jul 28 00:16:51 user nova-compute[70709]: </nova:instance>
Jul 28 00:16:51 user nova-compute[70709]:  {{(pid=70709) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-786b725c-98a9-4608-838c-a7fc854900ed tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "interface-4789522e-1b10-41d7-9332-649b5aaf5270-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.366s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG nova.network.neutron [req-a7bdb0da-a4c0-4f5f-8d29-247ecee9d71b req-31318bb2-5b29-4acd-a0b3-5653aea8360e service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updated VIF entry in instance network info cache for port f13d9ff3-8b48-48f6-9a03-28c9f491d05f. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG nova.network.neutron [req-a7bdb0da-a4c0-4f5f-8d29-247ecee9d71b req-31318bb2-5b29-4acd-a0b3-5653aea8360e service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updating instance_info_cache with network_info: [{"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "address": "fa:16:3e:a1:93:d2", "network": {"id": "23b485f5-cc59-4a7e-8bfc-d0bded63ce99", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-959400954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13d9ff3-8b", "ovs_interfaceid": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a7bdb0da-a4c0-4f5f-8d29-247ecee9d71b req-31318bb2-5b29-4acd-a0b3-5653aea8360e service nova] Releasing lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:51 user nova-compute[70709]: DEBUG nova.objects.instance [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lazy-loading 'flavor' on Instance uuid 4789522e-1b10-41d7-9332-649b5aaf5270 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:52 user nova-compute[70709]: INFO nova.compute.manager [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Attaching volume e7bf49f1-bf63-48c0-9253-7a5b1eb9415e to /dev/vdb
Jul 28 00:16:52 user nova-compute[70709]: DEBUG os_brick.utils [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7553f1-194d-447f-949b-75fd58166d79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bcc9c0-39b6-484c-bcf3-75c4b2023e3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-vif-plugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] No waiting events found dispatching network-vif-plugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:52 user nova-compute[70709]: WARNING nova.compute.manager [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received unexpected event network-vif-plugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f for instance with vm_state active and task_state None.
Jul 28 00:16:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-vif-plugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] No waiting events found dispatching network-vif-plugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:16:52 user nova-compute[70709]: WARNING nova.compute.manager [req-d3ce1068-a38d-459a-9d8b-58f41aea7b49 req-a939ac08-a5b6-4ac7-89a3-b8014812a00e service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received unexpected event network-vif-plugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f for instance with vm_state active and task_state None.
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff653da-8e0a-4d2e-841b-2601a21bb117]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32a87ee-06df-4c36-b7a6-e4b56bff5dbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:16:52 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:16:52 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[342a56b7-5905-454a-bb8a-c22e8ab8fd6e]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG os_brick.utils [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:52 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updating existing volume attachment record: c04be2fd-b03a-476e-b98b-267b4a9a1912 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:16:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHRKkSYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:57 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:57 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:57 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[742de930-aa9e-4751-b76f-862795153372]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:16:57 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de3e978-839c-4d2e-bd69-92e6f8a2ee55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0] added
Jul 28 00:16:57 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1df9a0c-4fa1-461e-b92f-55a07687731c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[47738f4e-3643-4f3a-9655-9967a56a4b94]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHRKkSYI {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHRKkSYI" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[06311174-ba54-4465-bd7b-bc67d30f8c34]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nHRKkSYI'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8930090-4b35-494e-919b-63d0fc63afc0]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[51281ca3-7bb4-45f5-abac-76226b22bb1b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[17920ce1-a75c-4e67-a3cd-95441768e8a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0, portal: 172.16.0.220,3260]
Jul 28 00:16:57 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0, portal: 172.16.0.220,3260] successful.
Jul 28 00:16:57 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c9467a-3362-4228-b6fc-8c323b602c3d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c87a68-afc4-4e3b-bf21-22f69908e178]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:16:57 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7de17ea-28b6-49ba-8cb0-6e59e7eafca3]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:16:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHRKkSYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eObDcEIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:16:58 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26137363333613766', 'path': '/dev/sdg'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137363333613766', 'path': '/dev/sdg'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.558s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:58 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:16:58 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG nova.objects.instance [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lazy-loading 'flavor' on Instance uuid fadc10cd-bf2a-445f-8d0b-450cbed8fb8b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9335a8-9c6a-49fc-ad0f-6878729bd6a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:16:58 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:16:58 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:16:58 user nova-compute[70709]:   <source dev="/dev/sdg"/>
Jul 28 00:16:58 user nova-compute[70709]:   <target dev="sdc" bus="scsi"/>
Jul 28 00:16:58 user nova-compute[70709]:   <serial>80a6ffad-a922-42e0-8dba-b898853f52e0</serial>
Jul 28 00:16:58 user nova-compute[70709]:   <address type="drive" controller="0" unit="2"/>
Jul 28 00:16:58 user nova-compute[70709]: </disk>
Jul 28 00:16:58 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[65879443-6571-465b-b86b-75ad6d6a1813]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562] added
Jul 28 00:16:58 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a1b31b-1169-4014-9e4c-dacf91b62c19]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b171f80a-0364-49a7-af9b-483a166f2aea]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eObDcEIQ {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eObDcEIQ" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8a4e83-96e4-4ebc-9e78-c1efa589a96c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eObDcEIQ'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5ad7c8-f7cb-4ae2-822e-763520a6136a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6739b1b4-ba37-4105-899f-954db4e54d48]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba691b1-407c-41cc-827d-06e22d20bb28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260]
Jul 28 00:16:58 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260] successful.
Jul 28 00:16:58 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e313acdc-4580-46ae-b951-e93cbcd2228e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a306a-6bff-4d23-94b8-5df6c58b0a73]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:16:58 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e54bdf-663c-4a00-be29-9a7f581da81c]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:16:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eObDcEIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:16:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] No BDM found with device name sda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] No BDM found with device name sdc, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:16:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] No VIF found with MAC fa:16:3e:b7:2f:37, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:16:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-61e355c7-471f-4355-9d91-31056b77512d tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.078s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:16:59 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:16:59 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] <== connect_volume: return (1913ms) {'type': 'block', 'scsi_wwn': '26264316561393832', 'path': '/dev/sdh'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:16:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264316561393832', 'path': '/dev/sdh'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.objects.instance [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lazy-loading 'flavor' on Instance uuid 169813c4-7d36-4660-b2fa-4a27fe3e8c86 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:17:00 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:17:00 user nova-compute[70709]:   <source dev="/dev/sdh"/>
Jul 28 00:17:00 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:17:00 user nova-compute[70709]:   <serial>bd65011d-6aaf-416a-8cd6-9c2f5238a562</serial>
Jul 28 00:17:00 user nova-compute[70709]: </disk>
Jul 28 00:17:00 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:00 user nova-compute[70709]: INFO nova.compute.manager [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Detaching volume 80a6ffad-a922-42e0-8dba-b898853f52e0
Jul 28 00:17:00 user nova-compute[70709]: INFO nova.virt.block_device [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Attempting to driver detach volume 80a6ffad-a922-42e0-8dba-b898853f52e0 from mountpoint /dev/sdc
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Attempting to detach device sdc from instance fadc10cd-bf2a-445f-8d0b-450cbed8fb8b from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:17:00 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:17:00 user nova-compute[70709]:   <source dev="/dev/sdg"/>
Jul 28 00:17:00 user nova-compute[70709]:   <target dev="sdc" bus="scsi"/>
Jul 28 00:17:00 user nova-compute[70709]:   <serial>80a6ffad-a922-42e0-8dba-b898853f52e0</serial>
Jul 28 00:17:00 user nova-compute[70709]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 28 00:17:00 user nova-compute[70709]: </disk>
Jul 28 00:17:00 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:17:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Successfully detached device sdc from instance fadc10cd-bf2a-445f-8d0b-450cbed8fb8b from the persistent domain config.
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance fadc10cd-bf2a-445f-8d0b-450cbed8fb8b from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:17:00 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:17:00 user nova-compute[70709]:   <source dev="/dev/sdg"/>
Jul 28 00:17:00 user nova-compute[70709]:   <target dev="sdc" bus="scsi"/>
Jul 28 00:17:00 user nova-compute[70709]:   <serial>80a6ffad-a922-42e0-8dba-b898853f52e0</serial>
Jul 28 00:17:00 user nova-compute[70709]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 28 00:17:00 user nova-compute[70709]: </disk>
Jul 28 00:17:00 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkHGqvDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:00 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:00 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:00 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae153a9f-c537-458c-9bc5-efa6b98c6eb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:17:00 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a24ae0-46eb-4b24-a15d-5415d3a4b102]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e] added
Jul 28 00:17:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[084cef37-17ae-4c07-ac37-2073855c4d85]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2dc310-3b65-4ba9-ab31-4dd7b3874ef2]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WkHGqvDx {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WkHGqvDx" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bffdf6-a027-4d66-b313-88f7a7345a17]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WkHGqvDx'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4538cbb1-dc92-4a4e-b03b-efc51f684e6f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b714baf6-7952-49eb-90f4-b7605612cf8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8a0cf5-e964-47f3-9383-b7600ce0b43a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e, portal: 172.16.0.220,3260]
Jul 28 00:17:00 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[44838052-f49e-410d-b8b6-d9e319aad18a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[de991790-05db-47a1-831b-5afc9d6c9ed3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c424f0dd-d9b7-41d4-aa26-8f0aa0a4d3fc]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503420.6692939, fadc10cd-bf2a-445f-8d0b-450cbed8fb8b => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance fadc10cd-bf2a-445f-8d0b-450cbed8fb8b {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:17:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Successfully detached device sdc from instance fadc10cd-bf2a-445f-8d0b-450cbed8fb8b from the live domain config.
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHRKkSYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:00 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] No VIF found with MAC fa:16:3e:2b:ad:e1, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58831c2b-4788-4ea5-8c55-1ee947e4ed3d tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.985s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkHGqvDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23734376132653064', 'path': '/dev/sdi'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734376132653064', 'path': '/dev/sdi'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.893s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG nova.objects.instance [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lazy-loading 'flavor' on Instance uuid 4789522e-1b10-41d7-9332-649b5aaf5270 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fcc212-c902-4886-abed-74dce31eb8a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:17:01 user nova-compute[70709]: No targets found.
Jul 28 00:17:01 user nova-compute[70709]: iSNS:
Jul 28 00:17:01 user nova-compute[70709]: No targets found.
Jul 28 00:17:01 user nova-compute[70709]: STATIC:
Jul 28 00:17:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:17:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:17:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234
Jul 28 00:17:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562
Jul 28 00:17:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e
Jul 28 00:17:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af
Jul 28 00:17:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb
Jul 28 00:17:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0
Jul 28 00:17:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:01 user nova-compute[70709]: FIRMWARE:
Jul 28 00:17:01 user nova-compute[70709]: No targets found.
Jul 28 00:17:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:17:01 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:17:01 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:17:01 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:17:01 user nova-compute[70709]:   <source dev="/dev/sdi"/>
Jul 28 00:17:01 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:17:01 user nova-compute[70709]:   <serial>e7bf49f1-bf63-48c0-9253-7a5b1eb9415e</serial>
Jul 28 00:17:01 user nova-compute[70709]: </disk>
Jul 28 00:17:01 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9158048b-d3c5-4af0-9cd9-4f3fd3867f99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[50467d5c-fe85-443c-ae04-7f34bf816f22]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 (non-flash)
Jul 28 00:17:01 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b9d1b63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0'): ({'sdg'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Removing single pathed devices sdg {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48cb998-e3ac-4526-a14a-55ea42e5cf08]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdd64e9-9e32-4cb4-8891-39d581166cc2]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Flushing IO for device /dev/sdg {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfdf6d4-f5d6-4115-9e6f-7975f889d419]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d88e37-73d4-4168-8b5a-db9a192e471f]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] SCSI volumes sdg have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[488aa2bf-987a-4dd5-89c2-8188823f6fb7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30473f9-0f45-4b9c-9a01-fe27cf33b276]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0, portal: 172.16.0.220,3260]
Jul 28 00:17:01 user nova-compute[70709]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6ffad-a922-42e0-8dba-b898853f52e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29bab1f-de35-42eb-bca8-4eddb67936ac]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] <== disconnect_volume: return (1240ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] No BDM found with device name hda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] No VIF found with MAC fa:16:3e:44:03:ee, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fddccc1f-0e09-47e9-94f2-64891fb61f2f tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.029s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG os_brick.utils [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f21c5a-b13b-46aa-b478-c54ac6c9e1c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d99de31-078c-498a-bac4-aa06bbbd0308]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[149aab55-dde6-423b-b8e2-9ef7e3ae5398]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48d79de-d8c8-4769-a5a8-fe6efc87215e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:17:02 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[953804d4-b7b1-4386-bba8-823bdf7e2de0]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG os_brick.utils [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:02 user nova-compute[70709]: INFO nova.compute.manager [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Swapping volume bd65011d-6aaf-416a-8cd6-9c2f5238a562 for 9d094cce-ebc7-4b16-bf25-95eda3130a6b
Jul 28 00:17:02 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lazy-loading 'flavor' on Instance uuid fadc10cd-bf2a-445f-8d0b-450cbed8fb8b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b8e86c88-704e-40ac-8d4a-bc4c30c48abc tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.766s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:03 user nova-compute[70709]: INFO nova.compute.manager [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Detaching volume e7bf49f1-bf63-48c0-9253-7a5b1eb9415e
Jul 28 00:17:03 user nova-compute[70709]: INFO nova.virt.block_device [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Attempting to driver detach volume e7bf49f1-bf63-48c0-9253-7a5b1eb9415e from mountpoint /dev/vdb
Jul 28 00:17:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Attempting to detach device vdb from instance 4789522e-1b10-41d7-9332-649b5aaf5270 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:17:03 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:17:03 user nova-compute[70709]:   <source dev="/dev/sdi"/>
Jul 28 00:17:03 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:17:03 user nova-compute[70709]:   <serial>e7bf49f1-bf63-48c0-9253-7a5b1eb9415e</serial>
Jul 28 00:17:03 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 28 00:17:03 user nova-compute[70709]: </disk>
Jul 28 00:17:03 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:17:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Successfully detached device vdb from instance 4789522e-1b10-41d7-9332-649b5aaf5270 from the persistent domain config.
Jul 28 00:17:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4789522e-1b10-41d7-9332-649b5aaf5270 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:17:03 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:17:03 user nova-compute[70709]:   <source dev="/dev/sdi"/>
Jul 28 00:17:03 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:17:03 user nova-compute[70709]:   <serial>e7bf49f1-bf63-48c0-9253-7a5b1eb9415e</serial>
Jul 28 00:17:03 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 28 00:17:03 user nova-compute[70709]: </disk>
Jul 28 00:17:03 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:03 user nova-compute[70709]: INFO nova.compute.manager [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Terminating instance
Jul 28 00:17:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-2aba3e3c-9b66-41f1-b397-92367f26fa05 req-97a70763-cdaf-4a74-8a19-8eb9a499f2aa service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Received event network-vif-unplugged-2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2aba3e3c-9b66-41f1-b397-92367f26fa05 req-97a70763-cdaf-4a74-8a19-8eb9a499f2aa service nova] Acquiring lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2aba3e3c-9b66-41f1-b397-92367f26fa05 req-97a70763-cdaf-4a74-8a19-8eb9a499f2aa service nova] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2aba3e3c-9b66-41f1-b397-92367f26fa05 req-97a70763-cdaf-4a74-8a19-8eb9a499f2aa service nova] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-2aba3e3c-9b66-41f1-b397-92367f26fa05 req-97a70763-cdaf-4a74-8a19-8eb9a499f2aa service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] No waiting events found dispatching network-vif-unplugged-2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-2aba3e3c-9b66-41f1-b397-92367f26fa05 req-97a70763-cdaf-4a74-8a19-8eb9a499f2aa service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Received event network-vif-unplugged-2c14e4aa-47f7-4638-9571-de623dacdd7b for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503424.1123884, 4789522e-1b10-41d7-9332-649b5aaf5270 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4789522e-1b10-41d7-9332-649b5aaf5270 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:17:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Successfully detached device vdb from instance 4789522e-1b10-41d7-9332-649b5aaf5270 from the live domain config.
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkHGqvDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:04 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8e1608-8497-4325-88cd-e3770aec7170]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:17:04 user nova-compute[70709]: No targets found.
Jul 28 00:17:04 user nova-compute[70709]: iSNS:
Jul 28 00:17:04 user nova-compute[70709]: No targets found.
Jul 28 00:17:04 user nova-compute[70709]: STATIC:
Jul 28 00:17:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:17:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:17:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234
Jul 28 00:17:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562
Jul 28 00:17:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e
Jul 28 00:17:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af
Jul 28 00:17:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb
Jul 28 00:17:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:04 user nova-compute[70709]: FIRMWARE:
Jul 28 00:17:04 user nova-compute[70709]: No targets found.
Jul 28 00:17:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:17:04 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:17:04 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fdf375-5e42-47ad-9700-952d7256e2c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72cd2ef-9d29-4d52-8e8d-706795564cb7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:04 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b9058a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e'): ({'sdi'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Removing single pathed devices sdi {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24f3955-2a73-4e00-bea9-f9c36d4ef607]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.035s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9261b6e-b6ae-4d04-bfa6-fb9ff45074c9]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Flushing IO for device /dev/sdi {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f703996a-8787-412f-b206-481ffc66ec2d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.056s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b96ff58-d96c-4280-b69c-9fca66c98d7d]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] SCSI volumes sdi have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32c9375-7d06-4c98-9dda-9a491cefc80c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9d0463-1340-44d3-994c-fa22055c0af5]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e, portal: 172.16.0.220,3260]
Jul 28 00:17:04 user nova-compute[70709]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf49f1-bf63-48c0-9253-7a5b1eb9415e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dea3ad-7e65-4216-845f-ef59e32b3e3d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] <== disconnect_volume: return (388ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:17:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Instance destroyed successfully.
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.objects.instance [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lazy-loading 'resources' on Instance uuid fadc10cd-bf2a-445f-8d0b-450cbed8fb8b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1556765586',display_name='tempest-AttachSCSIVolumeTestJSON-server-1556765586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1556765586',id=8,image_ref='bbb5145b-5bff-414c-8a94-7fa9b8fbc341',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVk+n/ULg9wrcQ2fYGP7D5VrPNwUmIJrwymTTfd9FUSmwu/rSJwkBrLAitIhQXKz4bgB3RZUgStNFcTomrVqsZQ+GIswHb+7QYC2XVu0YRr/QGvcoNOCoJvXK9gar6KOg==',key_name='tempest-keypair-2094520553',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:15:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='822cbb8b476c43f1a9fa2d932d9625ad',ramdisk_id='',reservation_id='r-cuswdeje',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbb5145b-5bff-414c-8a94-7fa9b8fbc341',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-711986765',owner_user_name='tempest-AttachSCSIVolumeTestJSON-711986765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315e8b854d5546e98195e2fb6340469b',uuid=fadc10cd-bf2a-445f-8d0b-450cbed8fb8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "address": "fa:16:3e:b7:2f:37", "network": {"id": "227b7608-fa54-48a0-b970-0387ef09b50f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1366593134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822cbb8b476c43f1a9fa2d932d9625ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c14e4aa-47", "ovs_interfaceid": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Converting VIF {"id": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "address": "fa:16:3e:b7:2f:37", "network": {"id": "227b7608-fa54-48a0-b970-0387ef09b50f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1366593134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822cbb8b476c43f1a9fa2d932d9625ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c14e4aa-47", "ovs_interfaceid": "2c14e4aa-47f7-4638-9571-de623dacdd7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=2c14e4aa-47f7-4638-9571-de623dacdd7b,network=Network(227b7608-fa54-48a0-b970-0387ef09b50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c14e4aa-47') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG os_vif [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=2c14e4aa-47f7-4638-9571-de623dacdd7b,network=Network(227b7608-fa54-48a0-b970-0387ef09b50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c14e4aa-47') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c14e4aa-47, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:04 user nova-compute[70709]: INFO os_vif [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=2c14e4aa-47f7-4638-9571-de623dacdd7b,network=Network(227b7608-fa54-48a0-b970-0387ef09b50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c14e4aa-47')
Jul 28 00:17:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Deleting instance files /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b_del
Jul 28 00:17:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Deletion of /opt/stack/data/nova/instances/fadc10cd-bf2a-445f-8d0b-450cbed8fb8b_del complete
Jul 28 00:17:04 user nova-compute[70709]: INFO nova.compute.manager [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 28 00:17:04 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:17:04 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.objects.instance [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lazy-loading 'flavor' on Instance uuid 4789522e-1b10-41d7-9332-649b5aaf5270 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5279086f-94ff-42d5-b0ac-e89a243efdb8 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.924s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:17:05 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Took 1.00 seconds to deallocate network for instance.
Jul 28 00:17:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "interface-4789522e-1b10-41d7-9332-649b5aaf5270-f13d9ff3-8b48-48f6-9a03-28c9f491d05f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "interface-4789522e-1b10-41d7-9332-649b5aaf5270-f13d9ff3-8b48-48f6-9a03-28c9f491d05f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.objects.instance [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lazy-loading 'flavor' on Instance uuid 4789522e-1b10-41d7-9332-649b5aaf5270 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-330796388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-330796388',id=9,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoBYj2u47hm72HhPB+cTlKzbBr01X98haFYfPWO+EXKwci2MxT+ZwG+mgNy/3QVDHnu7QwR0/IxM01QqzXGpS0obA/XwoFe0OALm1jPCLHs+e/CkiKFa7ONMv9sWpS8gg==',key_name='tempest-keypair-409851532',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:15:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='428557cbe58946ccb2e7afd4bc9c233f',ramdisk_id='',reservation_id='r-6gkdaj2k',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1986096815',owner_user_name='tempest-TaggedAttachmentsTest-1986096815-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fbbbdee1153489ca8062e2dbf4dc5df',uuid=4789522e-1b10-41d7-9332-649b5aaf5270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "address": "fa:16:3e:a1:93:d2", "network": {"id": "23b485f5-cc59-4a7e-8bfc-d0bded63ce99", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-959400954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13d9ff3-8b", "ovs_interfaceid": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converting VIF {"id": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "address": "fa:16:3e:a1:93:d2", "network": {"id": "23b485f5-cc59-4a7e-8bfc-d0bded63ce99", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-959400954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13d9ff3-8b", "ovs_interfaceid": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=f13d9ff3-8b48-48f6-9a03-28c9f491d05f,network=Network(23b485f5-cc59-4a7e-8bfc-d0bded63ce99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13d9ff3-8b') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a1:93:d2"/><model type="virtio"/><mtu size="1442"/><target dev="tapf13d9ff3-8b"/></interface> {{(pid=70709) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a1:93:d2"/><model type="virtio"/><mtu size="1442"/><target dev="tapf13d9ff3-8b"/></interface> {{(pid=70709) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Attempting to detach device tapf13d9ff3-8b from instance 4789522e-1b10-41d7-9332-649b5aaf5270 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] detach device xml: <interface type="ethernet">
Jul 28 00:17:05 user nova-compute[70709]:   <mac address="fa:16:3e:a1:93:d2"/>
Jul 28 00:17:05 user nova-compute[70709]:   <model type="virtio"/>
Jul 28 00:17:05 user nova-compute[70709]:   <mtu size="1442"/>
Jul 28 00:17:05 user nova-compute[70709]:   <target dev="tapf13d9ff3-8b"/>
Jul 28 00:17:05 user nova-compute[70709]: </interface>
Jul 28 00:17:05 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a1:93:d2"/><model type="virtio"/><mtu size="1442"/><target dev="tapf13d9ff3-8b"/></interface> {{(pid=70709) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a1:93:d2"/><model type="virtio"/><mtu size="1442"/><target dev="tapf13d9ff3-8b"/></interface>not found in domain: <domain type='kvm' id='10'>
Jul 28 00:17:05 user nova-compute[70709]:   <name>instance-00000009</name>
Jul 28 00:17:05 user nova-compute[70709]:   <uuid>4789522e-1b10-41d7-9332-649b5aaf5270</uuid>
Jul 28 00:17:05 user nova-compute[70709]:   <metadata>
Jul 28 00:17:05 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:17:05 user nova-compute[70709]:   <nova:package version="0.0.0"/>
Jul 28 00:17:05 user nova-compute[70709]:   <nova:name>tempest-device-tagging-server-330796388</nova:name>
Jul 28 00:17:05 user nova-compute[70709]:   <nova:creationTime>2023-07-28 00:16:51</nova:creationTime>
Jul 28 00:17:05 user nova-compute[70709]:   <nova:flavor name="m1.tiny">
Jul 28 00:17:05 user nova-compute[70709]:     <nova:memory>512</nova:memory>
Jul 28 00:17:05 user nova-compute[70709]:     <nova:disk>1</nova:disk>
Jul 28 00:17:05 user nova-compute[70709]:     <nova:swap>0</nova:swap>
Jul 28 00:17:05 user nova-compute[70709]:     <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:17:05 user nova-compute[70709]:     <nova:vcpus>1</nova:vcpus>
Jul 28 00:17:05 user nova-compute[70709]:   </nova:flavor>
Jul 28 00:17:05 user nova-compute[70709]:   <nova:owner>
Jul 28 00:17:05 user nova-compute[70709]:     <nova:user uuid="5fbbbdee1153489ca8062e2dbf4dc5df">tempest-TaggedAttachmentsTest-1986096815-project-member</nova:user>
Jul 28 00:17:05 user nova-compute[70709]:     <nova:project uuid="428557cbe58946ccb2e7afd4bc9c233f">tempest-TaggedAttachmentsTest-1986096815</nova:project>
Jul 28 00:17:05 user nova-compute[70709]:   </nova:owner>
Jul 28 00:17:05 user nova-compute[70709]:   <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:17:05 user nova-compute[70709]:   <nova:ports>
Jul 28 00:17:05 user nova-compute[70709]:     <nova:port uuid="3a29154a-ca72-43a4-a111-81c2ac1be6f7">
Jul 28 00:17:05 user nova-compute[70709]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 28 00:17:05 user nova-compute[70709]:     </nova:port>
Jul 28 00:17:05 user nova-compute[70709]:     <nova:port uuid="f13d9ff3-8b48-48f6-9a03-28c9f491d05f">
Jul 28 00:17:05 user nova-compute[70709]:       <nova:ip type="fixed" address="10.10.10.26" ipVersion="4"/>
Jul 28 00:17:05 user nova-compute[70709]:     </nova:port>
Jul 28 00:17:05 user nova-compute[70709]:   </nova:ports>
Jul 28 00:17:05 user nova-compute[70709]: </nova:instance>
Jul 28 00:17:05 user nova-compute[70709]:   </metadata>
Jul 28 00:17:05 user nova-compute[70709]:   <memory unit='KiB'>524288</memory>
Jul 28 00:17:05 user nova-compute[70709]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 28 00:17:05 user nova-compute[70709]:   <vcpu placement='static'>1</vcpu>
Jul 28 00:17:05 user nova-compute[70709]:   <resource>
Jul 28 00:17:05 user nova-compute[70709]:     <partition>/machine</partition>
Jul 28 00:17:05 user nova-compute[70709]:   </resource>
Jul 28 00:17:05 user nova-compute[70709]:   <sysinfo type='smbios'>
Jul 28 00:17:05 user nova-compute[70709]:     <system>
Jul 28 00:17:05 user nova-compute[70709]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 28 00:17:05 user nova-compute[70709]:       <entry name='product'>OpenStack Nova</entry>
Jul 28 00:17:05 user nova-compute[70709]:       <entry name='version'>0.0.0</entry>
Jul 28 00:17:05 user nova-compute[70709]:       <entry name='serial'>4789522e-1b10-41d7-9332-649b5aaf5270</entry>
Jul 28 00:17:05 user nova-compute[70709]:       <entry name='uuid'>4789522e-1b10-41d7-9332-649b5aaf5270</entry>
Jul 28 00:17:05 user nova-compute[70709]:       <entry name='family'>Virtual Machine</entry>
Jul 28 00:17:05 user nova-compute[70709]:     </system>
Jul 28 00:17:05 user nova-compute[70709]:   </sysinfo>
Jul 28 00:17:05 user nova-compute[70709]:   <os>
Jul 28 00:17:05 user nova-compute[70709]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 28 00:17:05 user nova-compute[70709]:     <boot dev='hd'/>
Jul 28 00:17:05 user nova-compute[70709]:     <smbios mode='sysinfo'/>
Jul 28 00:17:05 user nova-compute[70709]:   </os>
Jul 28 00:17:05 user nova-compute[70709]:   <features>
Jul 28 00:17:05 user nova-compute[70709]:     <acpi/>
Jul 28 00:17:05 user nova-compute[70709]:     <apic/>
Jul 28 00:17:05 user nova-compute[70709]:     <vmcoreinfo state='on'/>
Jul 28 00:17:05 user nova-compute[70709]:   </features>
Jul 28 00:17:05 user nova-compute[70709]:   <cpu mode='custom' match='exact' check='full'>
Jul 28 00:17:05 user nova-compute[70709]:     <model fallback='forbid'>Nehalem</model>
Jul 28 00:17:05 user nova-compute[70709]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 28 00:17:05 user nova-compute[70709]:     <feature policy='require' name='vme'/>
Jul 28 00:17:05 user nova-compute[70709]:     <feature policy='require' name='x2apic'/>
Jul 28 00:17:05 user nova-compute[70709]:     <feature policy='require' name='hypervisor'/>
Jul 28 00:17:05 user nova-compute[70709]:   </cpu>
Jul 28 00:17:05 user nova-compute[70709]:   <clock offset='utc'>
Jul 28 00:17:05 user nova-compute[70709]:     <timer name='pit' tickpolicy='delay'/>
Jul 28 00:17:05 user nova-compute[70709]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 28 00:17:05 user nova-compute[70709]:     <timer name='hpet' present='no'/>
Jul 28 00:17:05 user nova-compute[70709]:   </clock>
Jul 28 00:17:05 user nova-compute[70709]:   <on_poweroff>destroy</on_poweroff>
Jul 28 00:17:05 user nova-compute[70709]:   <on_reboot>restart</on_reboot>
Jul 28 00:17:05 user nova-compute[70709]:   <on_crash>destroy</on_crash>
Jul 28 00:17:05 user nova-compute[70709]:   <devices>
Jul 28 00:17:05 user nova-compute[70709]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 28 00:17:05 user nova-compute[70709]:     <disk type='file' device='disk'>
Jul 28 00:17:05 user nova-compute[70709]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 28 00:17:05 user nova-compute[70709]:       <source file='/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk' index='2'/>
Jul 28 00:17:05 user nova-compute[70709]:       <backingStore type='file' index='3'>
Jul 28 00:17:05 user nova-compute[70709]:         <format type='raw'/>
Jul 28 00:17:05 user nova-compute[70709]:         <source file='/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025'/>
Jul 28 00:17:05 user nova-compute[70709]:         <backingStore/>
Jul 28 00:17:05 user nova-compute[70709]:       </backingStore>
Jul 28 00:17:05 user nova-compute[70709]:       <target dev='vda' bus='virtio'/>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='virtio-disk0'/>
Jul 28 00:17:05 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </disk>
Jul 28 00:17:05 user nova-compute[70709]:     <disk type='file' device='cdrom'>
Jul 28 00:17:05 user nova-compute[70709]:       <driver name='qemu' type='raw' cache='none'/>
Jul 28 00:17:05 user nova-compute[70709]:       <source file='/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk.config' index='1'/>
Jul 28 00:17:05 user nova-compute[70709]:       <backingStore/>
Jul 28 00:17:05 user nova-compute[70709]:       <target dev='hda' bus='ide'/>
Jul 28 00:17:05 user nova-compute[70709]:       <readonly/>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='ide0-0-0'/>
Jul 28 00:17:05 user nova-compute[70709]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </disk>
Jul 28 00:17:05 user nova-compute[70709]:     <controller type='usb' index='0' model='none'>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='usb'/>
Jul 28 00:17:05 user nova-compute[70709]:     </controller>
Jul 28 00:17:05 user nova-compute[70709]:     <controller type='pci' index='0' model='pci-root'>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='pci.0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </controller>
Jul 28 00:17:05 user nova-compute[70709]:     <controller type='ide' index='0'>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='ide'/>
Jul 28 00:17:05 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 28 00:17:05 user nova-compute[70709]:     </controller>
Jul 28 00:17:05 user nova-compute[70709]:     <interface type='ethernet'>
Jul 28 00:17:05 user nova-compute[70709]:       <mac address='fa:16:3e:44:03:ee'/>
Jul 28 00:17:05 user nova-compute[70709]:       <target dev='tap3a29154a-ca'/>
Jul 28 00:17:05 user nova-compute[70709]:       <model type='virtio'/>
Jul 28 00:17:05 user nova-compute[70709]:       <mtu size='1442'/>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='net0'/>
Jul 28 00:17:05 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </interface>
Jul 28 00:17:05 user nova-compute[70709]:     <interface type='ethernet'>
Jul 28 00:17:05 user nova-compute[70709]:       <mac address='fa:16:3e:a1:93:d2'/>
Jul 28 00:17:05 user nova-compute[70709]:       <target dev='tapf13d9ff3-8b'/>
Jul 28 00:17:05 user nova-compute[70709]:       <model type='virtio'/>
Jul 28 00:17:05 user nova-compute[70709]:       <mtu size='1442'/>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='net1'/>
Jul 28 00:17:05 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </interface>
Jul 28 00:17:05 user nova-compute[70709]:     <serial type='pty'>
Jul 28 00:17:05 user nova-compute[70709]:       <source path='/dev/pts/9'/>
Jul 28 00:17:05 user nova-compute[70709]:       <log file='/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/console.log' append='off'/>
Jul 28 00:17:05 user nova-compute[70709]:       <target type='isa-serial' port='0'>
Jul 28 00:17:05 user nova-compute[70709]:         <model name='isa-serial'/>
Jul 28 00:17:05 user nova-compute[70709]:       </target>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='serial0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </serial>
Jul 28 00:17:05 user nova-compute[70709]:     <console type='pty' tty='/dev/pts/9'>
Jul 28 00:17:05 user nova-compute[70709]:       <source path='/dev/pts/9'/>
Jul 28 00:17:05 user nova-compute[70709]:       <log file='/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/console.log' append='off'/>
Jul 28 00:17:05 user nova-compute[70709]:       <target type='serial' port='0'/>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='serial0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </console>
Jul 28 00:17:05 user nova-compute[70709]:     <input type='mouse' bus='ps2'>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='input0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </input>
Jul 28 00:17:05 user nova-compute[70709]:     <input type='keyboard' bus='ps2'>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='input1'/>
Jul 28 00:17:05 user nova-compute[70709]:     </input>
Jul 28 00:17:05 user nova-compute[70709]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Jul 28 00:17:05 user nova-compute[70709]:       <listen type='address' address='0.0.0.0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </graphics>
Jul 28 00:17:05 user nova-compute[70709]:     <audio id='1' type='none'/>
Jul 28 00:17:05 user nova-compute[70709]:     <video>
Jul 28 00:17:05 user nova-compute[70709]:       <model type='virtio' heads='1' primary='yes'/>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='video0'/>
Jul 28 00:17:05 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </video>
Jul 28 00:17:05 user nova-compute[70709]:     <memballoon model='virtio'>
Jul 28 00:17:05 user nova-compute[70709]:       <stats period='10'/>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='balloon0'/>
Jul 28 00:17:05 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </memballoon>
Jul 28 00:17:05 user nova-compute[70709]:     <rng model='virtio'>
Jul 28 00:17:05 user nova-compute[70709]:       <backend model='random'>/dev/urandom</backend>
Jul 28 00:17:05 user nova-compute[70709]:       <alias name='rng0'/>
Jul 28 00:17:05 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 28 00:17:05 user nova-compute[70709]:     </rng>
Jul 28 00:17:05 user nova-compute[70709]:   </devices>
Jul 28 00:17:05 user nova-compute[70709]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 28 00:17:05 user nova-compute[70709]:     <label>libvirt-4789522e-1b10-41d7-9332-649b5aaf5270</label>
Jul 28 00:17:05 user nova-compute[70709]:     <imagelabel>libvirt-4789522e-1b10-41d7-9332-649b5aaf5270</imagelabel>
Jul 28 00:17:05 user nova-compute[70709]:   </seclabel>
Jul 28 00:17:05 user nova-compute[70709]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 28 00:17:05 user nova-compute[70709]:     <label>+64055:+108</label>
Jul 28 00:17:05 user nova-compute[70709]:     <imagelabel>+64055:+108</imagelabel>
Jul 28 00:17:05 user nova-compute[70709]:   </seclabel>
Jul 28 00:17:05 user nova-compute[70709]: </domain>
Jul 28 00:17:05 user nova-compute[70709]:  {{(pid=70709) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 28 00:17:05 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Successfully detached device tapf13d9ff3-8b from instance 4789522e-1b10-41d7-9332-649b5aaf5270 from the persistent domain config.
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] (1/8): Attempting to detach device tapf13d9ff3-8b with device alias net1 from instance 4789522e-1b10-41d7-9332-649b5aaf5270 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:17:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] detach device xml: <interface type="ethernet">
Jul 28 00:17:05 user nova-compute[70709]:   <mac address="fa:16:3e:a1:93:d2"/>
Jul 28 00:17:05 user nova-compute[70709]:   <model type="virtio"/>
Jul 28 00:17:05 user nova-compute[70709]:   <mtu size="1442"/>
Jul 28 00:17:05 user nova-compute[70709]:   <target dev="tapf13d9ff3-8b"/>
Jul 28 00:17:05 user nova-compute[70709]: </interface>
Jul 28 00:17:05 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-2b1dff8f-4f9d-4e15-8ee9-b2563d2056a8 req-57609921-0691-4891-ba70-c988c2c3a7bc service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Received event network-vif-plugged-2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2b1dff8f-4f9d-4e15-8ee9-b2563d2056a8 req-57609921-0691-4891-ba70-c988c2c3a7bc service nova] Acquiring lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2b1dff8f-4f9d-4e15-8ee9-b2563d2056a8 req-57609921-0691-4891-ba70-c988c2c3a7bc service nova] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2b1dff8f-4f9d-4e15-8ee9-b2563d2056a8 req-57609921-0691-4891-ba70-c988c2c3a7bc service nova] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-2b1dff8f-4f9d-4e15-8ee9-b2563d2056a8 req-57609921-0691-4891-ba70-c988c2c3a7bc service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] No waiting events found dispatching network-vif-plugged-2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:06 user nova-compute[70709]: WARNING nova.compute.manager [req-2b1dff8f-4f9d-4e15-8ee9-b2563d2056a8 req-57609921-0691-4891-ba70-c988c2c3a7bc service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Received unexpected event network-vif-plugged-2c14e4aa-47f7-4638-9571-de623dacdd7b for instance with vm_state deleted and task_state None.
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-2b1dff8f-4f9d-4e15-8ee9-b2563d2056a8 req-57609921-0691-4891-ba70-c988c2c3a7bc service nova] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Received event network-vif-deleted-2c14e4aa-47f7-4638-9571-de623dacdd7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:06 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Deleted allocations for instance fadc10cd-bf2a-445f-8d0b-450cbed8fb8b
Jul 28 00:17:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503426.2952874, 4789522e-1b10-41d7-9332-649b5aaf5270 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Start waiting for the detach event from libvirt for device tapf13d9ff3-8b with device alias net1 for instance 4789522e-1b10-41d7-9332-649b5aaf5270 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a1:93:d2"/><model type="virtio"/><mtu size="1442"/><target dev="tapf13d9ff3-8b"/></interface> {{(pid=70709) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a1:93:d2"/><model type="virtio"/><mtu size="1442"/><target dev="tapf13d9ff3-8b"/></interface>not found in domain: <domain type='kvm' id='10'>
Jul 28 00:17:06 user nova-compute[70709]:   <name>instance-00000009</name>
Jul 28 00:17:06 user nova-compute[70709]:   <uuid>4789522e-1b10-41d7-9332-649b5aaf5270</uuid>
Jul 28 00:17:06 user nova-compute[70709]:   <metadata>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:17:06 user nova-compute[70709]:   <nova:package version="0.0.0"/>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:name>tempest-device-tagging-server-330796388</nova:name>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:creationTime>2023-07-28 00:16:51</nova:creationTime>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:flavor name="m1.tiny">
Jul 28 00:17:06 user nova-compute[70709]:     <nova:memory>512</nova:memory>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:disk>1</nova:disk>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:swap>0</nova:swap>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:vcpus>1</nova:vcpus>
Jul 28 00:17:06 user nova-compute[70709]:   </nova:flavor>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:owner>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:user uuid="5fbbbdee1153489ca8062e2dbf4dc5df">tempest-TaggedAttachmentsTest-1986096815-project-member</nova:user>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:project uuid="428557cbe58946ccb2e7afd4bc9c233f">tempest-TaggedAttachmentsTest-1986096815</nova:project>
Jul 28 00:17:06 user nova-compute[70709]:   </nova:owner>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:ports>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:port uuid="3a29154a-ca72-43a4-a111-81c2ac1be6f7">
Jul 28 00:17:06 user nova-compute[70709]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 28 00:17:06 user nova-compute[70709]:     </nova:port>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:port uuid="f13d9ff3-8b48-48f6-9a03-28c9f491d05f">
Jul 28 00:17:06 user nova-compute[70709]:       <nova:ip type="fixed" address="10.10.10.26" ipVersion="4"/>
Jul 28 00:17:06 user nova-compute[70709]:     </nova:port>
Jul 28 00:17:06 user nova-compute[70709]:   </nova:ports>
Jul 28 00:17:06 user nova-compute[70709]: </nova:instance>
Jul 28 00:17:06 user nova-compute[70709]:   </metadata>
Jul 28 00:17:06 user nova-compute[70709]:   <memory unit='KiB'>524288</memory>
Jul 28 00:17:06 user nova-compute[70709]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 28 00:17:06 user nova-compute[70709]:   <vcpu placement='static'>1</vcpu>
Jul 28 00:17:06 user nova-compute[70709]:   <resource>
Jul 28 00:17:06 user nova-compute[70709]:     <partition>/machine</partition>
Jul 28 00:17:06 user nova-compute[70709]:   </resource>
Jul 28 00:17:06 user nova-compute[70709]:   <sysinfo type='smbios'>
Jul 28 00:17:06 user nova-compute[70709]:     <system>
Jul 28 00:17:06 user nova-compute[70709]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 28 00:17:06 user nova-compute[70709]:       <entry name='product'>OpenStack Nova</entry>
Jul 28 00:17:06 user nova-compute[70709]:       <entry name='version'>0.0.0</entry>
Jul 28 00:17:06 user nova-compute[70709]:       <entry name='serial'>4789522e-1b10-41d7-9332-649b5aaf5270</entry>
Jul 28 00:17:06 user nova-compute[70709]:       <entry name='uuid'>4789522e-1b10-41d7-9332-649b5aaf5270</entry>
Jul 28 00:17:06 user nova-compute[70709]:       <entry name='family'>Virtual Machine</entry>
Jul 28 00:17:06 user nova-compute[70709]:     </system>
Jul 28 00:17:06 user nova-compute[70709]:   </sysinfo>
Jul 28 00:17:06 user nova-compute[70709]:   <os>
Jul 28 00:17:06 user nova-compute[70709]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 28 00:17:06 user nova-compute[70709]:     <boot dev='hd'/>
Jul 28 00:17:06 user nova-compute[70709]:     <smbios mode='sysinfo'/>
Jul 28 00:17:06 user nova-compute[70709]:   </os>
Jul 28 00:17:06 user nova-compute[70709]:   <features>
Jul 28 00:17:06 user nova-compute[70709]:     <acpi/>
Jul 28 00:17:06 user nova-compute[70709]:     <apic/>
Jul 28 00:17:06 user nova-compute[70709]:     <vmcoreinfo state='on'/>
Jul 28 00:17:06 user nova-compute[70709]:   </features>
Jul 28 00:17:06 user nova-compute[70709]:   <cpu mode='custom' match='exact' check='full'>
Jul 28 00:17:06 user nova-compute[70709]:     <model fallback='forbid'>Nehalem</model>
Jul 28 00:17:06 user nova-compute[70709]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 28 00:17:06 user nova-compute[70709]:     <feature policy='require' name='vme'/>
Jul 28 00:17:06 user nova-compute[70709]:     <feature policy='require' name='x2apic'/>
Jul 28 00:17:06 user nova-compute[70709]:     <feature policy='require' name='hypervisor'/>
Jul 28 00:17:06 user nova-compute[70709]:   </cpu>
Jul 28 00:17:06 user nova-compute[70709]:   <clock offset='utc'>
Jul 28 00:17:06 user nova-compute[70709]:     <timer name='pit' tickpolicy='delay'/>
Jul 28 00:17:06 user nova-compute[70709]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 28 00:17:06 user nova-compute[70709]:     <timer name='hpet' present='no'/>
Jul 28 00:17:06 user nova-compute[70709]:   </clock>
Jul 28 00:17:06 user nova-compute[70709]:   <on_poweroff>destroy</on_poweroff>
Jul 28 00:17:06 user nova-compute[70709]:   <on_reboot>restart</on_reboot>
Jul 28 00:17:06 user nova-compute[70709]:   <on_crash>destroy</on_crash>
Jul 28 00:17:06 user nova-compute[70709]:   <devices>
Jul 28 00:17:06 user nova-compute[70709]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 28 00:17:06 user nova-compute[70709]:     <disk type='file' device='disk'>
Jul 28 00:17:06 user nova-compute[70709]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 28 00:17:06 user nova-compute[70709]:       <source file='/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk' index='2'/>
Jul 28 00:17:06 user nova-compute[70709]:       <backingStore type='file' index='3'>
Jul 28 00:17:06 user nova-compute[70709]:         <format type='raw'/>
Jul 28 00:17:06 user nova-compute[70709]:         <source file='/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025'/>
Jul 28 00:17:06 user nova-compute[70709]:         <backingStore/>
Jul 28 00:17:06 user nova-compute[70709]:       </backingStore>
Jul 28 00:17:06 user nova-compute[70709]:       <target dev='vda' bus='virtio'/>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='virtio-disk0'/>
Jul 28 00:17:06 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 28 00:17:06 user nova-compute[70709]:     </disk>
Jul 28 00:17:06 user nova-compute[70709]:     <disk type='file' device='cdrom'>
Jul 28 00:17:06 user nova-compute[70709]:       <driver name='qemu' type='raw' cache='none'/>
Jul 28 00:17:06 user nova-compute[70709]:       <source file='/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk.config' index='1'/>
Jul 28 00:17:06 user nova-compute[70709]:       <backingStore/>
Jul 28 00:17:06 user nova-compute[70709]:       <target dev='hda' bus='ide'/>
Jul 28 00:17:06 user nova-compute[70709]:       <readonly/>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='ide0-0-0'/>
Jul 28 00:17:06 user nova-compute[70709]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 28 00:17:06 user nova-compute[70709]:     </disk>
Jul 28 00:17:06 user nova-compute[70709]:     <controller type='usb' index='0' model='none'>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='usb'/>
Jul 28 00:17:06 user nova-compute[70709]:     </controller>
Jul 28 00:17:06 user nova-compute[70709]:     <controller type='pci' index='0' model='pci-root'>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='pci.0'/>
Jul 28 00:17:06 user nova-compute[70709]:     </controller>
Jul 28 00:17:06 user nova-compute[70709]:     <controller type='ide' index='0'>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='ide'/>
Jul 28 00:17:06 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 28 00:17:06 user nova-compute[70709]:     </controller>
Jul 28 00:17:06 user nova-compute[70709]:     <interface type='ethernet'>
Jul 28 00:17:06 user nova-compute[70709]:       <mac address='fa:16:3e:44:03:ee'/>
Jul 28 00:17:06 user nova-compute[70709]:       <target dev='tap3a29154a-ca'/>
Jul 28 00:17:06 user nova-compute[70709]:       <model type='virtio'/>
Jul 28 00:17:06 user nova-compute[70709]:       <mtu size='1442'/>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='net0'/>
Jul 28 00:17:06 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 28 00:17:06 user nova-compute[70709]:     </interface>
Jul 28 00:17:06 user nova-compute[70709]:     <serial type='pty'>
Jul 28 00:17:06 user nova-compute[70709]:       <source path='/dev/pts/9'/>
Jul 28 00:17:06 user nova-compute[70709]:       <log file='/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/console.log' append='off'/>
Jul 28 00:17:06 user nova-compute[70709]:       <target type='isa-serial' port='0'>
Jul 28 00:17:06 user nova-compute[70709]:         <model name='isa-serial'/>
Jul 28 00:17:06 user nova-compute[70709]:       </target>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='serial0'/>
Jul 28 00:17:06 user nova-compute[70709]:     </serial>
Jul 28 00:17:06 user nova-compute[70709]:     <console type='pty' tty='/dev/pts/9'>
Jul 28 00:17:06 user nova-compute[70709]:       <source path='/dev/pts/9'/>
Jul 28 00:17:06 user nova-compute[70709]:       <log file='/opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/console.log' append='off'/>
Jul 28 00:17:06 user nova-compute[70709]:       <target type='serial' port='0'/>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='serial0'/>
Jul 28 00:17:06 user nova-compute[70709]:     </console>
Jul 28 00:17:06 user nova-compute[70709]:     <input type='mouse' bus='ps2'>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='input0'/>
Jul 28 00:17:06 user nova-compute[70709]:     </input>
Jul 28 00:17:06 user nova-compute[70709]:     <input type='keyboard' bus='ps2'>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='input1'/>
Jul 28 00:17:06 user nova-compute[70709]:     </input>
Jul 28 00:17:06 user nova-compute[70709]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Jul 28 00:17:06 user nova-compute[70709]:       <listen type='address' address='0.0.0.0'/>
Jul 28 00:17:06 user nova-compute[70709]:     </graphics>
Jul 28 00:17:06 user nova-compute[70709]:     <audio id='1' type='none'/>
Jul 28 00:17:06 user nova-compute[70709]:     <video>
Jul 28 00:17:06 user nova-compute[70709]:       <model type='virtio' heads='1' primary='yes'/>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='video0'/>
Jul 28 00:17:06 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 28 00:17:06 user nova-compute[70709]:     </video>
Jul 28 00:17:06 user nova-compute[70709]:     <memballoon model='virtio'>
Jul 28 00:17:06 user nova-compute[70709]:       <stats period='10'/>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='balloon0'/>
Jul 28 00:17:06 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 28 00:17:06 user nova-compute[70709]:     </memballoon>
Jul 28 00:17:06 user nova-compute[70709]:     <rng model='virtio'>
Jul 28 00:17:06 user nova-compute[70709]:       <backend model='random'>/dev/urandom</backend>
Jul 28 00:17:06 user nova-compute[70709]:       <alias name='rng0'/>
Jul 28 00:17:06 user nova-compute[70709]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 28 00:17:06 user nova-compute[70709]:     </rng>
Jul 28 00:17:06 user nova-compute[70709]:   </devices>
Jul 28 00:17:06 user nova-compute[70709]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 28 00:17:06 user nova-compute[70709]:     <label>libvirt-4789522e-1b10-41d7-9332-649b5aaf5270</label>
Jul 28 00:17:06 user nova-compute[70709]:     <imagelabel>libvirt-4789522e-1b10-41d7-9332-649b5aaf5270</imagelabel>
Jul 28 00:17:06 user nova-compute[70709]:   </seclabel>
Jul 28 00:17:06 user nova-compute[70709]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 28 00:17:06 user nova-compute[70709]:     <label>+64055:+108</label>
Jul 28 00:17:06 user nova-compute[70709]:     <imagelabel>+64055:+108</imagelabel>
Jul 28 00:17:06 user nova-compute[70709]:   </seclabel>
Jul 28 00:17:06 user nova-compute[70709]: </domain>
Jul 28 00:17:06 user nova-compute[70709]:  {{(pid=70709) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 28 00:17:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Successfully detached device tapf13d9ff3-8b from instance 4789522e-1b10-41d7-9332-649b5aaf5270 from the live domain config.
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-330796388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-330796388',id=9,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoBYj2u47hm72HhPB+cTlKzbBr01X98haFYfPWO+EXKwci2MxT+ZwG+mgNy/3QVDHnu7QwR0/IxM01QqzXGpS0obA/XwoFe0OALm1jPCLHs+e/CkiKFa7ONMv9sWpS8gg==',key_name='tempest-keypair-409851532',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:15:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='428557cbe58946ccb2e7afd4bc9c233f',ramdisk_id='',reservation_id='r-6gkdaj2k',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1986096815',owner_user_name='tempest-TaggedAttachmentsTest-1986096815-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fbbbdee1153489ca8062e2dbf4dc5df',uuid=4789522e-1b10-41d7-9332-649b5aaf5270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "address": "fa:16:3e:a1:93:d2", "network": {"id": "23b485f5-cc59-4a7e-8bfc-d0bded63ce99", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-959400954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13d9ff3-8b", "ovs_interfaceid": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converting VIF {"id": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "address": "fa:16:3e:a1:93:d2", "network": {"id": "23b485f5-cc59-4a7e-8bfc-d0bded63ce99", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-959400954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13d9ff3-8b", "ovs_interfaceid": "f13d9ff3-8b48-48f6-9a03-28c9f491d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=f13d9ff3-8b48-48f6-9a03-28c9f491d05f,network=Network(23b485f5-cc59-4a7e-8bfc-d0bded63ce99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13d9ff3-8b') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG os_vif [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=f13d9ff3-8b48-48f6-9a03-28c9f491d05f,network=Network(23b485f5-cc59-4a7e-8bfc-d0bded63ce99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13d9ff3-8b') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf13d9ff3-8b, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91909d02-d0b2-46b2-91c8-19f81ba5d468 tempest-AttachSCSIVolumeTestJSON-711986765 tempest-AttachSCSIVolumeTestJSON-711986765-project-member] Lock "fadc10cd-bf2a-445f-8d0b-450cbed8fb8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.644s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:06 user nova-compute[70709]: INFO os_vif [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=f13d9ff3-8b48-48f6-9a03-28c9f491d05f,network=Network(23b485f5-cc59-4a7e-8bfc-d0bded63ce99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13d9ff3-8b')
Jul 28 00:17:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:17:06 user nova-compute[70709]:   <nova:package version="0.0.0"/>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:name>tempest-device-tagging-server-330796388</nova:name>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:creationTime>2023-07-28 00:17:06</nova:creationTime>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:flavor name="m1.tiny">
Jul 28 00:17:06 user nova-compute[70709]:     <nova:memory>512</nova:memory>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:disk>1</nova:disk>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:swap>0</nova:swap>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:vcpus>1</nova:vcpus>
Jul 28 00:17:06 user nova-compute[70709]:   </nova:flavor>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:owner>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:user uuid="5fbbbdee1153489ca8062e2dbf4dc5df">tempest-TaggedAttachmentsTest-1986096815-project-member</nova:user>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:project uuid="428557cbe58946ccb2e7afd4bc9c233f">tempest-TaggedAttachmentsTest-1986096815</nova:project>
Jul 28 00:17:06 user nova-compute[70709]:   </nova:owner>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:17:06 user nova-compute[70709]:   <nova:ports>
Jul 28 00:17:06 user nova-compute[70709]:     <nova:port uuid="3a29154a-ca72-43a4-a111-81c2ac1be6f7">
Jul 28 00:17:06 user nova-compute[70709]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 28 00:17:06 user nova-compute[70709]:     </nova:port>
Jul 28 00:17:06 user nova-compute[70709]:   </nova:ports>
Jul 28 00:17:06 user nova-compute[70709]: </nova:instance>
Jul 28 00:17:06 user nova-compute[70709]:  {{(pid=70709) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 28 00:17:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquired lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Acquiring lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Acquiring lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:07 user nova-compute[70709]: INFO nova.compute.manager [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Terminating instance
Jul 28 00:17:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-a3a28c79-b09d-4a69-b6f5-325cf41694d0 req-1dad76ca-a821-4b78-a15f-da123b8191db service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Received event network-vif-unplugged-f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a3a28c79-b09d-4a69-b6f5-325cf41694d0 req-1dad76ca-a821-4b78-a15f-da123b8191db service nova] Acquiring lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a3a28c79-b09d-4a69-b6f5-325cf41694d0 req-1dad76ca-a821-4b78-a15f-da123b8191db service nova] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a3a28c79-b09d-4a69-b6f5-325cf41694d0 req-1dad76ca-a821-4b78-a15f-da123b8191db service nova] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-a3a28c79-b09d-4a69-b6f5-325cf41694d0 req-1dad76ca-a821-4b78-a15f-da123b8191db service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] No waiting events found dispatching network-vif-unplugged-f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-a3a28c79-b09d-4a69-b6f5-325cf41694d0 req-1dad76ca-a821-4b78-a15f-da123b8191db service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Received event network-vif-unplugged-f87fe565-011d-4475-b3af-11cef08ed7d9 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:17:08 user nova-compute[70709]: INFO nova.network.neutron [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Port f13d9ff3-8b48-48f6-9a03-28c9f491d05f from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updating instance_info_cache with network_info: [{"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Releasing lock "refresh_cache-4789522e-1b10-41d7-9332-649b5aaf5270" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-15a20f7f-e732-4252-bd1e-cfd6746f30d4 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "interface-4789522e-1b10-41d7-9332-649b5aaf5270-f13d9ff3-8b48-48f6-9a03-28c9f491d05f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.247s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-vif-unplugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] No waiting events found dispatching network-vif-unplugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:08 user nova-compute[70709]: WARNING nova.compute.manager [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received unexpected event network-vif-unplugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f for instance with vm_state active and task_state None.
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-vif-plugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] No waiting events found dispatching network-vif-plugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:08 user nova-compute[70709]: WARNING nova.compute.manager [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received unexpected event network-vif-plugged-f13d9ff3-8b48-48f6-9a03-28c9f491d05f for instance with vm_state active and task_state None.
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-8d747bf5-615e-4741-80e6-b21af44609d0 req-2238ad42-6571-4b9c-ace3-26f3d853a17c service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-vif-deleted-f13d9ff3-8b48-48f6-9a03-28c9f491d05f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:08 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Instance destroyed successfully.
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lazy-loading 'resources' on Instance uuid 7cb91b91-a2ec-4baf-bffe-e83aafd26a02 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-969363868',display_name='tempest-VolumesActionsTest-instance-969363868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-969363868',id=11,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:15:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76641fb174734c318eb37e92d14d97a3',ramdisk_id='',reservation_id='r-yqgv2r7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1261321922',owner_user_name='tempest-VolumesActionsTest-1261321922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:15:13Z,user_data=None,user_id='a60567e498d64f9c8d9dd088ac3472fa',uuid=7cb91b91-a2ec-4baf-bffe-e83aafd26a02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f87fe565-011d-4475-b3af-11cef08ed7d9", "address": "fa:16:3e:cf:59:f8", "network": {"id": "9c2370f4-26c4-4160-8ea6-e43d8ab0533d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1300993732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76641fb174734c318eb37e92d14d97a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87fe565-01", "ovs_interfaceid": "f87fe565-011d-4475-b3af-11cef08ed7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Converting VIF {"id": "f87fe565-011d-4475-b3af-11cef08ed7d9", "address": "fa:16:3e:cf:59:f8", "network": {"id": "9c2370f4-26c4-4160-8ea6-e43d8ab0533d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1300993732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76641fb174734c318eb37e92d14d97a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87fe565-01", "ovs_interfaceid": "f87fe565-011d-4475-b3af-11cef08ed7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:59:f8,bridge_name='br-int',has_traffic_filtering=True,id=f87fe565-011d-4475-b3af-11cef08ed7d9,network=Network(9c2370f4-26c4-4160-8ea6-e43d8ab0533d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87fe565-01') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG os_vif [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:59:f8,bridge_name='br-int',has_traffic_filtering=True,id=f87fe565-011d-4475-b3af-11cef08ed7d9,network=Network(9c2370f4-26c4-4160-8ea6-e43d8ab0533d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87fe565-01') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf87fe565-01, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:08 user nova-compute[70709]: INFO os_vif [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:59:f8,bridge_name='br-int',has_traffic_filtering=True,id=f87fe565-011d-4475-b3af-11cef08ed7d9,network=Network(9c2370f4-26c4-4160-8ea6-e43d8ab0533d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87fe565-01')
Jul 28 00:17:08 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Deleting instance files /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02_del
Jul 28 00:17:08 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Deletion of /opt/stack/data/nova/instances/7cb91b91-a2ec-4baf-bffe-e83aafd26a02_del complete
Jul 28 00:17:08 user nova-compute[70709]: INFO nova.compute.manager [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 28 00:17:08 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:17:08 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:17:09 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Took 0.63 seconds to deallocate network for instance.
Jul 28 00:17:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:09 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:17:09 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:17:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:09 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Deleted allocations for instance 7cb91b91-a2ec-4baf-bffe-e83aafd26a02
Jul 28 00:17:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f0d17e94-c939-4f52-92fe-f83cbd7db552 tempest-VolumesActionsTest-1261321922 tempest-VolumesActionsTest-1261321922-project-member] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.023s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:17:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-bc10319c-c61d-4050-b738-dbc9c390e846 req-ead54353-05a3-4d9e-8304-408d12d1efca service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Received event network-vif-plugged-f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bc10319c-c61d-4050-b738-dbc9c390e846 req-ead54353-05a3-4d9e-8304-408d12d1efca service nova] Acquiring lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bc10319c-c61d-4050-b738-dbc9c390e846 req-ead54353-05a3-4d9e-8304-408d12d1efca service nova] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bc10319c-c61d-4050-b738-dbc9c390e846 req-ead54353-05a3-4d9e-8304-408d12d1efca service nova] Lock "7cb91b91-a2ec-4baf-bffe-e83aafd26a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-bc10319c-c61d-4050-b738-dbc9c390e846 req-ead54353-05a3-4d9e-8304-408d12d1efca service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] No waiting events found dispatching network-vif-plugged-f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:09 user nova-compute[70709]: WARNING nova.compute.manager [req-bc10319c-c61d-4050-b738-dbc9c390e846 req-ead54353-05a3-4d9e-8304-408d12d1efca service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Received unexpected event network-vif-plugged-f87fe565-011d-4475-b3af-11cef08ed7d9 for instance with vm_state deleted and task_state None.
Jul 28 00:17:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-5fe793e6-fd71-4912-89d4-6155f74233ba req-c0213a1a-784d-4806-b0db-7849fcd51556 service nova] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Received event network-vif-deleted-f87fe565-011d-4475-b3af-11cef08ed7d9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAslYqNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '169813c4-7d36-4660-b2fa-4a27fe3e8c86', 'attached_at': '', 'detached_at': '', 'volume_id': '9d094cce-ebc7-4b16-bf25-95eda3130a6b', 'serial': '9d094cce-ebc7-4b16-bf25-95eda3130a6b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eObDcEIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '169813c4-7d36-4660-b2fa-4a27fe3e8c86', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'serial'} {{(pid=70709) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAslYqNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:10 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c894fc99-db0a-4418-94fb-83f008339b16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:17:10 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabafaf2-ed21-4fc5-8716-f52b3e9bbf67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b] added
Jul 28 00:17:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9ca9b4-c4ac-462e-948c-3cf7648d67d7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea728f-9a76-4919-94a0-6469f2cb9e9c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cAslYqNb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cAslYqNb" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b798db8-a9ce-458c-9f36-35637ede4139]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cAslYqNb'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e00bc71-2c96-4d94-8224-84f1f6b9d42d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[21856c9f-f5bf-45cb-b8e4-fbb31a8249d4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6480fb80-6608-416a-8f1d-c54fee69f1bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b, portal: 172.16.0.220,3260]
Jul 28 00:17:10 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bae1fa7-951c-47d8-85fe-4f928141a151]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[259202b5-b601-4446-bffd-6fb0d4a213bd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] HCTL ('38', '-', '-', 0) found on session 11 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0df282-5e91-4019-868d-19ac78445aef]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:10 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAslYqNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26639666665393238', 'path': '/dev/sdg'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639666665393238', 'path': '/dev/sdg'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG nova.objects.instance [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lazy-loading 'flavor' on Instance uuid 169813c4-7d36-4660-b2fa-4a27fe3e8c86 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:17:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 164626432 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 349175808 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 536870912 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 809500672 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:14 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:17:14 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:17:14 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=6980MB free_disk=25.511871337890625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:17:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance df55bbd3-31ab-42f8-9a71-4ed8e3c4428c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4789522e-1b10-41d7-9332-649b5aaf5270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 169813c4-7d36-4660-b2fa-4a27fe3e8c86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 22b20888-013f-4130-a709-dd7d7932ad80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 3139de03-95b1-4e8a-a15a-886dbd9cfb56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 955252736 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.756s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eObDcEIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:15 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93fe2fe-1853-4d0f-9a5a-0e54932cd9bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:17:15 user nova-compute[70709]: No targets found.
Jul 28 00:17:15 user nova-compute[70709]: iSNS:
Jul 28 00:17:15 user nova-compute[70709]: No targets found.
Jul 28 00:17:15 user nova-compute[70709]: STATIC:
Jul 28 00:17:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:17:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:17:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234
Jul 28 00:17:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562
Jul 28 00:17:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b
Jul 28 00:17:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af
Jul 28 00:17:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb
Jul 28 00:17:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:15 user nova-compute[70709]: FIRMWARE:
Jul 28 00:17:15 user nova-compute[70709]: No targets found.
Jul 28 00:17:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:17:15 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:17:15 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb706648-2344-4ad6-bbb9-d3bf34be705c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7b29f6-1f8d-4dd1-abdd-23c3103713f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:16 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:16 user nova-compute[70709]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:16 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b902756c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562'): ({'sdh'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Removing single pathed devices sdh {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ac8b49-d4e0-40bb-9665-ed177936f53f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6603dc14-fb00-465b-9183-d652da25112c]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Flushing IO for device /dev/sdh {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6f8e87-35ae-444c-965b-38ebe206454b]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca95fdb4-4840-4a7b-a703-ff3a1f9f2ae8]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] SCSI volumes sdh have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[516d46bf-da41-4518-9b27-426aa4cfe619]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[761fae2e-427c-494e-b198-c83ce466a4c8]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260]
Jul 28 00:17:16 user nova-compute[70709]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:16 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f46a58a-3033-48da-841b-c57cc2311633]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] <== disconnect_volume: return (353ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAslYqNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '169813c4-7d36-4660-b2fa-4a27fe3e8c86', 'attached_at': '', 'detached_at': '', 'volume_id': '9d094cce-ebc7-4b16-bf25-95eda3130a6b', 'serial'} {{(pid=70709) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] swap_volume: removing Cinder connection for volume bd65011d-6aaf-416a-8cd6-9c2f5238a562 {{(pid=70709) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:17:16 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] swap_volume: Updating volume bd65011d-6aaf-416a-8cd6-9c2f5238a562 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "cAslYqNb", "auth_password": "beqixQlIfgw43R", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "9d094cce-ebc7-4b16-bf25-95eda3130a6b"}, "status": "reserved", "instance": "169813c4-7d36-4660-b2fa-4a27fe3e8c86", "attached_at": "", "detached_at": "", "volume_id": "9d094cce-ebc7-4b16-bf25-95eda3130a6b", "serial": "9d094cce-ebc7-4b16-bf25-95eda3130a6b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9d094cce-ebc7-4b16-bf25-95eda3130a6b', 'no_device': None, 'attachment_id': 'c2406e94-41dc-4fac-988c-a08b0fc6270e'} {{(pid=70709) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eaf2d68f-17c9-4c9d-8ec9-b773b947ea45 tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.970s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating instance_info_cache with network_info: [{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG os_brick.utils [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de044cd-7d25-4965-8e86-d92d85299cba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a2aea7-fd3d-4233-8919-0ad83d81a1c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82ab92c-e340-4093-8dd5-1ed5ecf57330]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[950a7029-627a-4336-9c25-bcaf96f9cb36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:17:17 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:17:17 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0edb9b7-6b88-46ad-9cc9-e08aef31d183]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:17:17 user nova-compute[70709]: DEBUG os_brick.utils [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:18 user nova-compute[70709]: INFO nova.compute.manager [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Swapping volume 9d094cce-ebc7-4b16-bf25-95eda3130a6b for bd65011d-6aaf-416a-8cd6-9c2f5238a562
Jul 28 00:17:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:19 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503424.5441327, fadc10cd-bf2a-445f-8d0b-450cbed8fb8b => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:17:19 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] VM Stopped (Lifecycle Event)
Jul 28 00:17:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-baf229cb-934b-457e-a764-7e7b78bfc759 None None] [instance: fadc10cd-bf2a-445f-8d0b-450cbed8fb8b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:17:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:23 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503428.2605805, 7cb91b91-a2ec-4baf-bffe-e83aafd26a02 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:17:23 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] VM Stopped (Lifecycle Event)
Jul 28 00:17:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-19cc718e-9163-49eb-9ce2-b11783fdb94b None None] [instance: 7cb91b91-a2ec-4baf-bffe-e83aafd26a02] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:17:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:17:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:17:24 user nova-compute[70709]: INFO nova.compute.claims [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Claim successful on node user
Jul 28 00:17:25 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:17:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:17:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:17:25 user nova-compute[70709]: INFO nova.virt.block_device [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Booting with blank volume at /dev/vda
Jul 28 00:17:25 user nova-compute[70709]: DEBUG nova.policy [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa22ce59fc4742d4ab16292a8b3d6e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6929fa5cb2284dd8b94c387bf6e3fef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eObDcEIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '169813c4-7d36-4660-b2fa-4a27fe3e8c86', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'serial': 'bd65011d-6aaf-416a-8cd6-9c2f5238a562'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAslYqNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '9d094cce-ebc7-4b16-bf25-95eda3130a6b'}, 'status': 'reserved', 'instance': '169813c4-7d36-4660-b2fa-4a27fe3e8c86', 'attached_at': '', 'detached_at': '', 'volume_id': '9d094cce-ebc7-4b16-bf25-95eda3130a6b', 'serial'} {{(pid=70709) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eObDcEIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:25 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:25 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:25 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f86bd2-e98f-4e5d-a61e-991a07251fcd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:17:25 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.043s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c12bbd-6599-44f1-8dac-7a75d6d7df7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562] added
Jul 28 00:17:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e2d08f-7842-4d4f-bc70-c231df053b13]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f9ff1e-9db0-41b2-a101-9a60263437ca]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eObDcEIQ {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eObDcEIQ" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b08b61b-4595-411d-ab93-10c406fbdd59]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eObDcEIQ'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[48024a76-e5e7-44d4-8ed7-2b3256ffb7a5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf596f3b-a7df-45a5-a540-e1d704f2239a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7b9e98-ae90-4ed8-9210-3e64162a6c9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260]
Jul 28 00:17:26 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6a807c-faa7-43be-91b4-a775259e0d45]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[743d13fc-52ee-4837-b228-9c03b2fbdc87]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[16150c9c-4b62-4390-ae1d-b7621eaecafc]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eObDcEIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:17:26 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Successfully created port: bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Successfully updated port: bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquired lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-809a3ea9-9ec8-4cc5-a9cf-e5087971d288 req-a5fe4b59-df64-4f6e-8192-c2eebe3638ba service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-changed-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-809a3ea9-9ec8-4cc5-a9cf-e5087971d288 req-a5fe4b59-df64-4f6e-8192-c2eebe3638ba service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Refreshing instance network info cache due to event network-changed-bc1adc03-972b-4d2b-a9d6-94139d5726cc. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-809a3ea9-9ec8-4cc5-a9cf-e5087971d288 req-a5fe4b59-df64-4f6e-8192-c2eebe3638ba service nova] Acquiring lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26264316561393832', 'path': '/dev/sdh'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264316561393832', 'path': '/dev/sdh'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG nova.objects.instance [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lazy-loading 'flavor' on Instance uuid 169813c4-7d36-4660-b2fa-4a27fe3e8c86 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Updating instance_info_cache with network_info: [{"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Releasing lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Instance network_info: |[{"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-809a3ea9-9ec8-4cc5-a9cf-e5087971d288 req-a5fe4b59-df64-4f6e-8192-c2eebe3638ba service nova] Acquired lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG nova.network.neutron [req-809a3ea9-9ec8-4cc5-a9cf-e5087971d288 req-a5fe4b59-df64-4f6e-8192-c2eebe3638ba service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Refreshing network info cache for port bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:17:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:28 user nova-compute[70709]: DEBUG nova.compute.manager [req-04b61613-1275-4e87-91ec-69664b67c0d3 req-5c1723b0-df49-4e6f-a969-b34bf9edd390 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-changed-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:28 user nova-compute[70709]: DEBUG nova.compute.manager [req-04b61613-1275-4e87-91ec-69664b67c0d3 req-5c1723b0-df49-4e6f-a969-b34bf9edd390 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing instance network info cache due to event network-changed-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:17:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04b61613-1275-4e87-91ec-69664b67c0d3 req-5c1723b0-df49-4e6f-a969-b34bf9edd390 service nova] Acquiring lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:17:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04b61613-1275-4e87-91ec-69664b67c0d3 req-5c1723b0-df49-4e6f-a969-b34bf9edd390 service nova] Acquired lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:17:28 user nova-compute[70709]: DEBUG nova.network.neutron [req-04b61613-1275-4e87-91ec-69664b67c0d3 req-5c1723b0-df49-4e6f-a969-b34bf9edd390 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Refreshing network info cache for port ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:17:28 user nova-compute[70709]: DEBUG nova.network.neutron [req-809a3ea9-9ec8-4cc5-a9cf-e5087971d288 req-a5fe4b59-df64-4f6e-8192-c2eebe3638ba service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Updated VIF entry in instance network info cache for port bc1adc03-972b-4d2b-a9d6-94139d5726cc. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:17:28 user nova-compute[70709]: DEBUG nova.network.neutron [req-809a3ea9-9ec8-4cc5-a9cf-e5087971d288 req-a5fe4b59-df64-4f6e-8192-c2eebe3638ba service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Updating instance_info_cache with network_info: [{"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:17:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-809a3ea9-9ec8-4cc5-a9cf-e5087971d288 req-a5fe4b59-df64-4f6e-8192-c2eebe3638ba service nova] Releasing lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:17:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 141557760 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 294649856 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:29 user nova-compute[70709]: DEBUG nova.network.neutron [req-04b61613-1275-4e87-91ec-69664b67c0d3 req-5c1723b0-df49-4e6f-a969-b34bf9edd390 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updated VIF entry in instance network info cache for port ba83c348-f5ee-4af0-96ff-6fd6af6d37ab. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:17:29 user nova-compute[70709]: DEBUG nova.network.neutron [req-04b61613-1275-4e87-91ec-69664b67c0d3 req-5c1723b0-df49-4e6f-a969-b34bf9edd390 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating instance_info_cache with network_info: [{"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:17:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04b61613-1275-4e87-91ec-69664b67c0d3 req-5c1723b0-df49-4e6f-a969-b34bf9edd390 service nova] Releasing lock "refresh_cache-22b20888-013f-4130-a709-dd7d7932ad80" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:17:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 429916160 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 575668224 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 728760320 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "22b20888-013f-4130-a709-dd7d7932ad80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:30 user nova-compute[70709]: INFO nova.compute.manager [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Terminating instance
Jul 28 00:17:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 918552576 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 1043333120 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-d641cb3b-1841-43e0-9940-98ffba225261 req-016a2579-4fe1-42bd-bcff-387ffe8c13d9 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d641cb3b-1841-43e0-9940-98ffba225261 req-016a2579-4fe1-42bd-bcff-387ffe8c13d9 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d641cb3b-1841-43e0-9940-98ffba225261 req-016a2579-4fe1-42bd-bcff-387ffe8c13d9 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d641cb3b-1841-43e0-9940-98ffba225261 req-016a2579-4fe1-42bd-bcff-387ffe8c13d9 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-d641cb3b-1841-43e0-9940-98ffba225261 req-016a2579-4fe1-42bd-bcff-387ffe8c13d9 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-unplugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-d641cb3b-1841-43e0-9940-98ffba225261 req-016a2579-4fe1-42bd-bcff-387ffe8c13d9 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb0e3352-a0e4-4c29-8448-5828958bb426 req-9cbe518b-b283-4674-bfc8-91d3982281e9 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb0e3352-a0e4-4c29-8448-5828958bb426 req-9cbe518b-b283-4674-bfc8-91d3982281e9 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb0e3352-a0e4-4c29-8448-5828958bb426 req-9cbe518b-b283-4674-bfc8-91d3982281e9 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb0e3352-a0e4-4c29-8448-5828958bb426 req-9cbe518b-b283-4674-bfc8-91d3982281e9 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb0e3352-a0e4-4c29-8448-5828958bb426 req-9cbe518b-b283-4674-bfc8-91d3982281e9 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-unplugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb0e3352-a0e4-4c29-8448-5828958bb426 req-9cbe518b-b283-4674-bfc8-91d3982281e9 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-192ee419-fe10-4eec-976a-977e6b2b28ac req-b944bb8c-e18c-47dd-920e-27b249527d8a service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-192ee419-fe10-4eec-976a-977e6b2b28ac req-b944bb8c-e18c-47dd-920e-27b249527d8a service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-192ee419-fe10-4eec-976a-977e6b2b28ac req-b944bb8c-e18c-47dd-920e-27b249527d8a service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-192ee419-fe10-4eec-976a-977e6b2b28ac req-b944bb8c-e18c-47dd-920e-27b249527d8a service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-192ee419-fe10-4eec-976a-977e6b2b28ac req-b944bb8c-e18c-47dd-920e-27b249527d8a service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-unplugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-192ee419-fe10-4eec-976a-977e6b2b28ac req-b944bb8c-e18c-47dd-920e-27b249527d8a service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG os_brick.utils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ee966b-6a1b-425d-9efd-c1905ad674ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a19c10-cade-4422-83b3-d2a3e79875fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9310d193-bdae-4e0b-a35a-87a92225d868]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[08298981-c52b-465e-9c50-1eacdd9e6811]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:17:31 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:17:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e80d27-59f6-4b52-a5c7-ec644d3e1b46]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG os_brick.utils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Updating existing volume attachment record: 0789d8a1-0963-456d-b1ec-1089c4fb4fc2 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAslYqNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '9d094cce-ebc7-4b16-bf25-95eda3130a6b'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:32 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f0f25a-6c0f-4134-9a46-8bb1a4343c82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:17:32 user nova-compute[70709]: No targets found.
Jul 28 00:17:32 user nova-compute[70709]: iSNS:
Jul 28 00:17:32 user nova-compute[70709]: No targets found.
Jul 28 00:17:32 user nova-compute[70709]: STATIC:
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: FIRMWARE:
Jul 28 00:17:32 user nova-compute[70709]: No targets found.
Jul 28 00:17:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:17:32 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:17:32 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[266034be-1bc6-4b7f-adb3-f27867dd5bc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc37f4b-8ce3-4e0d-84de-40e35ce33e9e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90235900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b'): ({'sdg'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Removing single pathed devices sdg {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[820f3200-d2d4-4968-a8f0-75b6c840f4ab]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb7996c-eb5d-4566-816c-31aca61ec0d6]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Flushing IO for device /dev/sdg {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f016b9-37be-4f40-af14-43f7e5a027c6]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Instance destroyed successfully.
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lazy-loading 'resources' on Instance uuid 22b20888-013f-4130-a709-dd7d7932ad80 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:16:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c1:04,bridge_name='br-int',has_traffic_filtering=True,id=ba83c348-f5ee-4af0-96ff-6fd6af6d37ab,network=Network(fc210791-5d93-41c2-b8ce-4157852203a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba83c348-f5') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c1:04,bridge_name='br-int',has_traffic_filtering=True,id=ba83c348-f5ee-4af0-96ff-6fd6af6d37ab,network=Network(fc210791-5d93-41c2-b8ce-4157852203a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba83c348-f5') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a57f16-4ac0-4cd8-a687-1d876832f491]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] SCSI volumes sdg have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba83c348-f5, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26639666665393238', '/dev/disk/by-id/scsi-1SCST_BIOf7418ee1-f9ffe928e3a6926a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f7418ee1') {{(pid=82455) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8848fc1a-2591-4afd-8a97-2d9284835350]: (4, None) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[351de829-870e-4a06-8d06-67afacb41e59]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: INFO os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c1:04,bridge_name='br-int',has_traffic_filtering=True,id=ba83c348-f5ee-4af0-96ff-6fd6af6d37ab,network=Network(fc210791-5d93-41c2-b8ce-4157852203a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba83c348-f5')
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:16:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6f:2e,bridge_name='br-int',has_traffic_filtering=True,id=a3ce0364-2010-4551-8ac3-ecbde1899c57,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa3ce0364-20') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6f:2e,bridge_name='br-int',has_traffic_filtering=True,id=a3ce0364-2010-4551-8ac3-ecbde1899c57,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa3ce0364-20') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3ce0364-20, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7495c356-bd03-437b-b13c-7545635322ac]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b, portal: 172.16.0.220,3260]
Jul 28 00:17:32 user nova-compute[70709]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d094cce-ebc7-4b16-bf25-95eda3130a6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[557cc3fc-7859-4706-9caa-fe5d52e71144]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] <== disconnect_volume: return (404ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: INFO os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6f:2e,bridge_name='br-int',has_traffic_filtering=True,id=a3ce0364-2010-4551-8ac3-ecbde1899c57,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa3ce0364-20')
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:16:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd381-c2e7-4df2-a82b-adb0ab303211,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped7cd381-c2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd381-c2e7-4df2-a82b-adb0ab303211,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped7cd381-c2') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped7cd381-c2, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: INFO os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd381-c2e7-4df2-a82b-adb0ab303211,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped7cd381-c2')
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:16:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "address": "fa:16:3e:ae:9c:a0", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cce9851-cb", "ovs_interfaceid": "0cce9851-cba8-4c4d-8094-8b2d6d513073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:9c:a0,bridge_name='br-int',has_traffic_filtering=True,id=0cce9851-cba8-4c4d-8094-8b2d6d513073,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cce9851-cb') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:9c:a0,bridge_name='br-int',has_traffic_filtering=True,id=0cce9851-cba8-4c4d-8094-8b2d6d513073,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cce9851-cb') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eObDcEIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '169813c4-7d36-4660-b2fa-4a27fe3e8c86', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'serial'} {{(pid=70709) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] swap_volume: removing Cinder connection for volume 9d094cce-ebc7-4b16-bf25-95eda3130a6b {{(pid=70709) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cce9851-cb, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: INFO os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:9c:a0,bridge_name='br-int',has_traffic_filtering=True,id=0cce9851-cba8-4c4d-8094-8b2d6d513073,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cce9851-cb')
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:16:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:e3:0f,bridge_name='br-int',has_traffic_filtering=True,id=18bfe0bf-52b4-4fa2-b716-de0a8acb27c0,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18bfe0bf-52') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:e3:0f,bridge_name='br-int',has_traffic_filtering=True,id=18bfe0bf-52b4-4fa2-b716-de0a8acb27c0,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18bfe0bf-52') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18bfe0bf-52, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: INFO os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:e3:0f,bridge_name='br-int',has_traffic_filtering=True,id=18bfe0bf-52b4-4fa2-b716-de0a8acb27c0,network=Network(4c51b096-ab4f-405e-9d45-f4e672f2cde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18bfe0bf-52')
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:16:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:85:07,bridge_name='br-int',has_traffic_filtering=True,id=90f98012-4803-4320-876d-05410ded4e63,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f98012-48') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:85:07,bridge_name='br-int',has_traffic_filtering=True,id=90f98012-4803-4320-876d-05410ded4e63,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f98012-48') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90f98012-48, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: INFO os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:85:07,bridge_name='br-int',has_traffic_filtering=True,id=90f98012-4803-4320-876d-05410ded4e63,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f98012-48')
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1055112727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1055112727',id=12,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz98gZw6zLd+CWeM6NpyrqRrwSJOivPCwnGAwqXTFPQig99or2oY7r8LYWZzDL9+zu+plV7kZTKHWEbtcr/gC6/0SMgMHLc7nq1K7irbJyKMWApc5kpqqD2ssi8b0N48A==',key_name='tempest-keypair-1961227028',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:16:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1e74bcec444c19a7caccfec7a5495c',ramdisk_id='',reservation_id='r-w1uzd6m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619687507',owner_user_name='tempest-TaggedBootDevicesTest-619687507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1313461455149229baa40380a1b9753',uuid=22b20888-013f-4130-a709-dd7d7932ad80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converting VIF {"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=2815f7a8-335d-4450-b234-ae0ffea44ba1,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2815f7a8-33') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=2815f7a8-335d-4450-b234-ae0ffea44ba1,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2815f7a8-33') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2815f7a8-33, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:32 user nova-compute[70709]: INFO os_vif [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=2815f7a8-335d-4450-b234-ae0ffea44ba1,network=Network(33add7bf-59ff-46f4-9be5-f7714313b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2815f7a8-33')
Jul 28 00:17:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSIQRJlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:32 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3131110d-4970-4711-b40c-7cc85dc58c01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:17:32 user nova-compute[70709]: No targets found.
Jul 28 00:17:32 user nova-compute[70709]: iSNS:
Jul 28 00:17:32 user nova-compute[70709]: No targets found.
Jul 28 00:17:32 user nova-compute[70709]: STATIC:
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb
Jul 28 00:17:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:32 user nova-compute[70709]: FIRMWARE:
Jul 28 00:17:32 user nova-compute[70709]: No targets found.
Jul 28 00:17:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:17:32 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:17:32 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2517624b-9568-4bf1-8ae1-63dea5a017dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bea9d1-e0b2-45f3-8787-6e3ba21bc778]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b905f5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af'): ({'sdc'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Removing single pathed devices sdc {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9848d2b-3ee1-400d-a92b-f5c7c8d7869e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a2ba9-65eb-4073-94d8-4d8f88b7c2bf]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Flushing IO for device /dev/sdc {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8d6c53-dce5-4e34-bee7-ab2c52d545ca]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:17:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68d327e-c2e7-4838-9d6c-91f3ec0bbb89]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e387c3-05e0-442d-8206-9a61bd786b8d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecc4bd7-ca3e-4a01-8d9b-4af1fd408052]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af, portal: 172.16.0.220,3260]
Jul 28 00:17:33 user nova-compute[70709]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5344d4e9-4ac7-4795-a6f9-86e054f9d4af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fb0983-ec11-49ce-a342-d2c7d42d4333]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] <== disconnect_volume: return (351ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfZpCxdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:33 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaf22d1-481f-4627-a730-401c49a029fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:17:33 user nova-compute[70709]: No targets found.
Jul 28 00:17:33 user nova-compute[70709]: iSNS:
Jul 28 00:17:33 user nova-compute[70709]: No targets found.
Jul 28 00:17:33 user nova-compute[70709]: STATIC:
Jul 28 00:17:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:17:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:17:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234
Jul 28 00:17:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562
Jul 28 00:17:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb
Jul 28 00:17:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:33 user nova-compute[70709]: FIRMWARE:
Jul 28 00:17:33 user nova-compute[70709]: No targets found.
Jul 28 00:17:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:17:33 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:17:33 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6915878c-ccbe-43ef-bfdf-d63e6109b75f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d367069a-15eb-4480-bcff-12ecb21cd9ef]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b905f5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234'): ({'sdb'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Removing single pathed devices sdb {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecea4239-7eef-4923-ae38-c2509f184fcd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:33 user nova-compute[70709]: WARNING nova.compute.manager [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab for instance with vm_state active and task_state deleting.
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-unplugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:33 user nova-compute[70709]: WARNING nova.compute.manager [req-7cafde4f-add6-4480-9ce9-ec4d38cafca7 req-5e558391-ba43-4ae3-b2de-99081ab2108d service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-0cce9851-cba8-4c4d-8094-8b2d6d513073 for instance with vm_state active and task_state deleting.
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[11085981-fbe3-443a-a1b0-08eee4fa5c5a]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Flushing IO for device /dev/sdb {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5d7fe5-b654-4f4d-89e3-6ad7bd588bdc]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e3c03c-9100-479d-90ff-274eb7fd7dd2]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:33 user nova-compute[70709]: WARNING nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-a3ce0364-2010-4551-8ac3-ecbde1899c57 for instance with vm_state active and task_state deleting.
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-unplugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:33 user nova-compute[70709]: WARNING nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 for instance with vm_state active and task_state deleting.
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-unplugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:33 user nova-compute[70709]: WARNING nova.compute.manager [req-f9456afd-4bf9-4a7b-8f81-a3a15bd71adf req-d9aa3087-b615-4397-9fa5-1d923bc78954 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-2815f7a8-335d-4450-b234-ae0ffea44ba1 for instance with vm_state active and task_state deleting.
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af75438-3dde-4a68-9c01-d6ca4076bc86]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[82490350-b05f-4805-875f-f4a7ed338b98]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234, portal: 172.16.0.220,3260]
Jul 28 00:17:33 user nova-compute[70709]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:33 user nova-compute[70709]: WARNING nova.compute.manager [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-ed7cd381-c2e7-4df2-a82b-adb0ab303211 for instance with vm_state active and task_state deleting.
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-unplugged-90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-unplugged-90f98012-4803-4320-876d-05410ded4e63 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-plugged-90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] Acquiring lock "22b20888-013f-4130-a709-dd7d7932ad80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] Lock "22b20888-013f-4130-a709-dd7d7932ad80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] No waiting events found dispatching network-vif-plugged-90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:33 user nova-compute[70709]: WARNING nova.compute.manager [req-885596d0-0661-4e6b-a09f-e231e62b8c7e req-3605990a-bba7-4dad-a168-8a74c6f37f24 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received unexpected event network-vif-plugged-90f98012-4803-4320-876d-05410ded4e63 for instance with vm_state active and task_state deleting.
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9934460d-deb7-473b-aab3-fd4b53be4234 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0716c98a-7407-4426-8e76-fcb44cbbd5ab]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] <== disconnect_volume: return (358ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] swap_volume: Updating volume 9d094cce-ebc7-4b16-bf25-95eda3130a6b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "eObDcEIQ", "auth_password": "mw5xor1XsgtTBv", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "bd65011d-6aaf-416a-8cd6-9c2f5238a562"}, "status": "reserved", "instance": "169813c4-7d36-4660-b2fa-4a27fe3e8c86", "attached_at": "", "detached_at": "", "volume_id": "bd65011d-6aaf-416a-8cd6-9c2f5238a562", "serial": "bd65011d-6aaf-416a-8cd6-9c2f5238a562"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'no_device': None, 'attachment_id': 'b72cb05a-35d0-470f-bcef-6b4321ed823e'} {{(pid=70709) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsYvTNIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:33 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2521b7cd-672a-46db-bdb5-f853355e33aa tempest-TestVolumeSwap-1838194120 tempest-TestVolumeSwap-1838194120-project-admin] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.845s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5041a65a-37e1-456f-877f-46fc629098b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:17:33 user nova-compute[70709]: No targets found.
Jul 28 00:17:33 user nova-compute[70709]: iSNS:
Jul 28 00:17:33 user nova-compute[70709]: No targets found.
Jul 28 00:17:33 user nova-compute[70709]: STATIC:
Jul 28 00:17:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:17:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:17:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562
Jul 28 00:17:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb
Jul 28 00:17:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:33 user nova-compute[70709]: FIRMWARE:
Jul 28 00:17:33 user nova-compute[70709]: No targets found.
Jul 28 00:17:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:17:33 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:17:33 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae920c9-1d0e-4171-84bc-a5b44cf8c121]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4114f88c-1bfa-4270-86a7-7def8120bece]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b9d24f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb'): ({'sdd'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Removing single pathed devices sdd {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7202d88-9fb6-4f66-a9f5-81999b112d66]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcb1d68-b54f-4965-b297-bf4bc6b55826]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Flushing IO for device /dev/sdd {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[23354dad-8b6c-4102-9c8f-596542f7e72e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08850bc-e1d6-4ff3-87da-4a0449f43dc7]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8c33ed-ae30-4bba-ae8e-d9f51b937eb7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e683960-478c-447b-9a3b-3b2ccaac2ed2]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb, portal: 172.16.0.220,3260]
Jul 28 00:17:33 user nova-compute[70709]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd57a0e-77fc-431a-8573-22b80adf48cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9a090b-dbce-450d-a267-64802a18016c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] <== disconnect_volume: return (318ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:17:33 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Deleting instance files /opt/stack/data/nova/instances/22b20888-013f-4130-a709-dd7d7932ad80_del
Jul 28 00:17:33 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Deletion of /opt/stack/data/nova/instances/22b20888-013f-4130-a709-dd7d7932ad80_del complete
Jul 28 00:17:33 user nova-compute[70709]: INFO nova.compute.manager [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Took 3.27 seconds to destroy the instance on the hypervisor.
Jul 28 00:17:33 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:17:33 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:34 user nova-compute[70709]: INFO nova.compute.manager [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Detaching volume bd65011d-6aaf-416a-8cd6-9c2f5238a562
Jul 28 00:17:34 user nova-compute[70709]: INFO nova.virt.block_device [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Attempting to driver detach volume bd65011d-6aaf-416a-8cd6-9c2f5238a562 from mountpoint /dev/vdb
Jul 28 00:17:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Attempting to detach device vdb from instance 169813c4-7d36-4660-b2fa-4a27fe3e8c86 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:17:34 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:17:34 user nova-compute[70709]:   <source dev="/dev/sdh"/>
Jul 28 00:17:34 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:17:34 user nova-compute[70709]:   <serial>bd65011d-6aaf-416a-8cd6-9c2f5238a562</serial>
Jul 28 00:17:34 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:17:34 user nova-compute[70709]: </disk>
Jul 28 00:17:34 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:17:34 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Successfully detached device vdb from instance 169813c4-7d36-4660-b2fa-4a27fe3e8c86 from the persistent domain config.
Jul 28 00:17:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 169813c4-7d36-4660-b2fa-4a27fe3e8c86 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:17:34 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:17:34 user nova-compute[70709]:   <source dev="/dev/sdh"/>
Jul 28 00:17:34 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:17:34 user nova-compute[70709]:   <serial>bd65011d-6aaf-416a-8cd6-9c2f5238a562</serial>
Jul 28 00:17:34 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:17:34 user nova-compute[70709]: </disk>
Jul 28 00:17:34 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503454.8455107, 169813c4-7d36-4660-b2fa-4a27fe3e8c86 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 169813c4-7d36-4660-b2fa-4a27fe3e8c86 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:17:34 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Successfully detached device vdb from instance 169813c4-7d36-4660-b2fa-4a27fe3e8c86 from the live domain config.
Jul 28 00:17:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eObDcEIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'bd65011d-6aaf-416a-8cd6-9c2f5238a562'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:34 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3bf4b5-a12c-4da3-bef0-dd80f7293302]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:17:34 user nova-compute[70709]: No targets found.
Jul 28 00:17:34 user nova-compute[70709]: iSNS:
Jul 28 00:17:34 user nova-compute[70709]: No targets found.
Jul 28 00:17:34 user nova-compute[70709]: STATIC:
Jul 28 00:17:34 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:17:34 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:34 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:34 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:17:34 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:34 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:34 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562
Jul 28 00:17:34 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:17:34 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:17:34 user nova-compute[70709]: FIRMWARE:
Jul 28 00:17:34 user nova-compute[70709]: No targets found.
Jul 28 00:17:34 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:17:34 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:17:34 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e94537-5c08-4ff3-ab1f-c0040182f959]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a9a1eb-f4a3-4635-9701-4bfbf5d1bbbb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:34 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:34 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:34 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 (non-flash)
Jul 28 00:17:34 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:34 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:34 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b905f4a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562'): ({'sdh'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Removing single pathed devices sdh {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac3eb8b-bd5f-4ffc-a33e-a9bf4763fd8f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff86d0f-e456-4d02-8ef6-9726ceb6c786]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Flushing IO for device /dev/sdh {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:17:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a4b7c7-49d7-4e2d-b84d-b2e93b440ac5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fc92cc-a876-4b70-a2b3-36681b40c1a8]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] SCSI volumes sdh have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc2acf9-3df9-4a2d-acb5-62e081ff936a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc533f5-6193-44e3-b7f4-7f49fde14ec2]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260]
Jul 28 00:17:35 user nova-compute[70709]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd65011d-6aaf-416a-8cd6-9c2f5238a562 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbabf7a-4c84-4b0c-ade2-0dfeff338cf4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] <== disconnect_volume: return (328ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG nova.compute.manager [req-22b47885-1304-4148-9ef6-f407044a4dff req-7bf98e6d-7afe-49f8-8316-eacf04984a08 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-deleted-0cce9851-cba8-4c4d-8094-8b2d6d513073 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:35 user nova-compute[70709]: INFO nova.compute.manager [req-22b47885-1304-4148-9ef6-f407044a4dff req-7bf98e6d-7afe-49f8-8316-eacf04984a08 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Neutron deleted interface 0cce9851-cba8-4c4d-8094-8b2d6d513073; detaching it from the instance and deleting it from the info cache
Jul 28 00:17:35 user nova-compute[70709]: DEBUG nova.network.neutron [req-22b47885-1304-4148-9ef6-f407044a4dff req-7bf98e6d-7afe-49f8-8316-eacf04984a08 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating instance_info_cache with network_info: [{"id": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "address": "fa:16:3e:c0:c1:04", "network": {"id": "fc210791-5d93-41c2-b8ce-4157852203a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-775976101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba83c348-f5", "ovs_interfaceid": "ba83c348-f5ee-4af0-96ff-6fd6af6d37ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "address": "fa:16:3e:d4:6f:2e", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ce0364-20", "ovs_interfaceid": "a3ce0364-2010-4551-8ac3-ecbde1899c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "address": "fa:16:3e:4e:c3:86", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd381-c2", "ovs_interfaceid": "ed7cd381-c2e7-4df2-a82b-adb0ab303211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "address": "fa:16:3e:9e:e3:0f", "network": {"id": "4c51b096-ab4f-405e-9d45-f4e672f2cde3", "bridge": "br-int", "label": "tempest-device-tagging-net1-654517916", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18bfe0bf-52", "ovs_interfaceid": "18bfe0bf-52b4-4fa2-b716-de0a8acb27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f98012-4803-4320-876d-05410ded4e63", "address": "fa:16:3e:4b:85:07", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f98012-48", "ovs_interfaceid": "90f98012-4803-4320-876d-05410ded4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "address": "fa:16:3e:a8:95:f5", "network": {"id": "33add7bf-59ff-46f4-9be5-f7714313b63f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648373782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1e74bcec444c19a7caccfec7a5495c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2815f7a8-33", "ovs_interfaceid": "2815f7a8-335d-4450-b234-ae0ffea44ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG nova.compute.manager [req-22b47885-1304-4148-9ef6-f407044a4dff req-7bf98e6d-7afe-49f8-8316-eacf04984a08 service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Detach interface failed, port_id=0cce9851-cba8-4c4d-8094-8b2d6d513073, reason: Instance 22b20888-013f-4130-a709-dd7d7932ad80 could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG nova.objects.instance [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lazy-loading 'flavor' on Instance uuid 169813c4-7d36-4660-b2fa-4a27fe3e8c86 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-049ed2fc-fbc4-45db-a5d0-ed44b4dc812a tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.633s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:37 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:17:37 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Took 3.60 seconds to deallocate network for instance.
Jul 28 00:17:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:37 user nova-compute[70709]: DEBUG nova.compute.manager [req-8ab67a9d-c740-4ba8-b962-8dffe3cd3efd req-b506f3a0-aee8-40f6-bebf-2e328080483c service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-deleted-2815f7a8-335d-4450-b234-ae0ffea44ba1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:37 user nova-compute[70709]: DEBUG nova.compute.manager [req-8ab67a9d-c740-4ba8-b962-8dffe3cd3efd req-b506f3a0-aee8-40f6-bebf-2e328080483c service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-deleted-ba83c348-f5ee-4af0-96ff-6fd6af6d37ab {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:37 user nova-compute[70709]: DEBUG nova.compute.manager [req-8ab67a9d-c740-4ba8-b962-8dffe3cd3efd req-b506f3a0-aee8-40f6-bebf-2e328080483c service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-deleted-18bfe0bf-52b4-4fa2-b716-de0a8acb27c0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:37 user nova-compute[70709]: DEBUG nova.compute.manager [req-8ab67a9d-c740-4ba8-b962-8dffe3cd3efd req-b506f3a0-aee8-40f6-bebf-2e328080483c service nova] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Received event network-vif-deleted-90f98012-4803-4320-876d-05410ded4e63 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:17:39 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Creating image(s)
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Ensure instance console log exists: /opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Start _get_guest_xml network_info=[{"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '0789d8a1-0963-456d-b1ec-1089c4fb4fc2', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fubBYVmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '159a0ce2-f6b6-45bf-a743-74da642a79fe', 'attached_at': '', 'detached_at': '', 'volume_id': 'a08c1c10-e7e4-4fae-a760-5bff01893ad5', 'serial': 'a08c1c10-e7e4-4fae-a760-5bff01893ad5'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:17:39 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:17:39 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fubBYVmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:17:39 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:39 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:17:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:17:39 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40ee285-7ba6-4b69-a75e-745c49b8ceb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:17:39 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d06236-444c-45cd-b069-6ffe4259e7a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5] added
Jul 28 00:17:39 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f8aef2-4d47-4dac-ac6b-9ef4593c6d05]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[64019cf7-0bf4-41fc-87d3-822dbe5e64af]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fubBYVmz {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fubBYVmz" returned: 0 in 0.032s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ad8918-f4c9-4184-a76a-57a763f6c91b]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fubBYVmz'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61cd2a0-5462-4630-bf5e-5e235cf07ab8]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:40 user nova-compute[70709]: INFO nova.compute.manager [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Took 2.53 seconds to detach 3 volumes for instance.
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4e7173-e574-4726-a922-96a991c9ad5c]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:40 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:40 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:40 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:40 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c458f42b-c472-43da-a975-31a031b28b03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5, portal: 172.16.0.220,3260]
Jul 28 00:17:40 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5, portal: 172.16.0.220,3260] successful.
Jul 28 00:17:40 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d503884-8eda-46b8-b90b-1eaec75871bc]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a25985c-1c01-4367-b8ef-e580b7756f61]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:17:40 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:40 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:40 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:17:40 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:17:40 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:17:40 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeb2d15-2ddf-412c-b9cc-f12e01b61090]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fubBYVmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:40 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Deleted allocations for instance 22b20888-013f-4130-a709-dd7d7932ad80
Jul 28 00:17:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b82123a9-eb27-47c4-8b5f-8bc8a392b057 tempest-TaggedBootDevicesTest-619687507 tempest-TaggedBootDevicesTest-619687507-project-member] Lock "22b20888-013f-4130-a709-dd7d7932ad80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.956s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26436623264633561', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436623264633561', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1655245855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1655245855',id=14,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-0sw5nxth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:17:26Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=159a0ce2-f6b6-45bf-a743-74da642a79fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ff:6a,bridge_name='br-int',has_traffic_filtering=True,id=bc1adc03-972b-4d2b-a9d6-94139d5726cc,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc1adc03-97') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG nova.objects.instance [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'pci_devices' on Instance uuid 159a0ce2-f6b6-45bf-a743-74da642a79fe {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:17:41 user nova-compute[70709]:   <uuid>159a0ce2-f6b6-45bf-a743-74da642a79fe</uuid>
Jul 28 00:17:41 user nova-compute[70709]:   <name>instance-0000000e</name>
Jul 28 00:17:41 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:17:41 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:17:41 user nova-compute[70709]:   <metadata>
Jul 28 00:17:41 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:17:41 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:17:41 user nova-compute[70709]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1655245855</nova:name>
Jul 28 00:17:41 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:17:39</nova:creationTime>
Jul 28 00:17:41 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:17:41 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:17:41 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:17:41 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:17:41 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:17:41 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:17:41 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:17:41 user nova-compute[70709]:       <nova:owner>
Jul 28 00:17:41 user nova-compute[70709]:         <nova:user uuid="fa22ce59fc4742d4ab16292a8b3d6e3f">tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member</nova:user>
Jul 28 00:17:41 user nova-compute[70709]:         <nova:project uuid="6929fa5cb2284dd8b94c387bf6e3fef6">tempest-ServerBootFromVolumeStableRescueTest-2075329923</nova:project>
Jul 28 00:17:41 user nova-compute[70709]:       </nova:owner>
Jul 28 00:17:41 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:17:41 user nova-compute[70709]:       <nova:ports>
Jul 28 00:17:41 user nova-compute[70709]:         <nova:port uuid="bc1adc03-972b-4d2b-a9d6-94139d5726cc">
Jul 28 00:17:41 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 28 00:17:41 user nova-compute[70709]:         </nova:port>
Jul 28 00:17:41 user nova-compute[70709]:       </nova:ports>
Jul 28 00:17:41 user nova-compute[70709]:     </nova:instance>
Jul 28 00:17:41 user nova-compute[70709]:   </metadata>
Jul 28 00:17:41 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:17:41 user nova-compute[70709]:     <system>
Jul 28 00:17:41 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:17:41 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:17:41 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:17:41 user nova-compute[70709]:       <entry name="serial">159a0ce2-f6b6-45bf-a743-74da642a79fe</entry>
Jul 28 00:17:41 user nova-compute[70709]:       <entry name="uuid">159a0ce2-f6b6-45bf-a743-74da642a79fe</entry>
Jul 28 00:17:41 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:17:41 user nova-compute[70709]:     </system>
Jul 28 00:17:41 user nova-compute[70709]:   </sysinfo>
Jul 28 00:17:41 user nova-compute[70709]:   <os>
Jul 28 00:17:41 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:17:41 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:17:41 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:17:41 user nova-compute[70709]:   </os>
Jul 28 00:17:41 user nova-compute[70709]:   <features>
Jul 28 00:17:41 user nova-compute[70709]:     <acpi/>
Jul 28 00:17:41 user nova-compute[70709]:     <apic/>
Jul 28 00:17:41 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:17:41 user nova-compute[70709]:   </features>
Jul 28 00:17:41 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:17:41 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:17:41 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:17:41 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:17:41 user nova-compute[70709]:   </clock>
Jul 28 00:17:41 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:17:41 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:17:41 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:17:41 user nova-compute[70709]:   </cpu>
Jul 28 00:17:41 user nova-compute[70709]:   <devices>
Jul 28 00:17:41 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:17:41 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:17:41 user nova-compute[70709]:       <source dev="/dev/sdb"/>
Jul 28 00:17:41 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:17:41 user nova-compute[70709]:       <serial>a08c1c10-e7e4-4fae-a760-5bff01893ad5</serial>
Jul 28 00:17:41 user nova-compute[70709]:     </disk>
Jul 28 00:17:41 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:17:41 user nova-compute[70709]:       <mac address="fa:16:3e:59:ff:6a"/>
Jul 28 00:17:41 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:17:41 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:17:41 user nova-compute[70709]:       <target dev="tapbc1adc03-97"/>
Jul 28 00:17:41 user nova-compute[70709]:     </interface>
Jul 28 00:17:41 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:17:41 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/console.log" append="off"/>
Jul 28 00:17:41 user nova-compute[70709]:     </serial>
Jul 28 00:17:41 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:17:41 user nova-compute[70709]:     <video>
Jul 28 00:17:41 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:17:41 user nova-compute[70709]:     </video>
Jul 28 00:17:41 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:17:41 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:17:41 user nova-compute[70709]:     </rng>
Jul 28 00:17:41 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:17:41 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:17:41 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:17:41 user nova-compute[70709]:     </memballoon>
Jul 28 00:17:41 user nova-compute[70709]:   </devices>
Jul 28 00:17:41 user nova-compute[70709]: </domain>
Jul 28 00:17:41 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1655245855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1655245855',id=14,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-0sw5nxth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:17:26Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=159a0ce2-f6b6-45bf-a743-74da642a79fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ff:6a,bridge_name='br-int',has_traffic_filtering=True,id=bc1adc03-972b-4d2b-a9d6-94139d5726cc,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc1adc03-97') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG os_vif [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ff:6a,bridge_name='br-int',has_traffic_filtering=True,id=bc1adc03-972b-4d2b-a9d6-94139d5726cc,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc1adc03-97') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc1adc03-97, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc1adc03-97, col_values=(('external_ids', {'iface-id': 'bc1adc03-972b-4d2b-a9d6-94139d5726cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:ff:6a', 'vm-uuid': '159a0ce2-f6b6-45bf-a743-74da642a79fe'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:41 user nova-compute[70709]: INFO os_vif [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ff:6a,bridge_name='br-int',has_traffic_filtering=True,id=bc1adc03-972b-4d2b-a9d6-94139d5726cc,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc1adc03-97')
Jul 28 00:17:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:17:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No VIF found with MAC fa:16:3e:59:ff:6a, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:17:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-70e6fcd5-3f74-4909-89a1-d65c9807266e req-824abd04-0a3e-4e00-a645-82117159ab75 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-70e6fcd5-3f74-4909-89a1-d65c9807266e req-824abd04-0a3e-4e00-a645-82117159ab75 service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-70e6fcd5-3f74-4909-89a1-d65c9807266e req-824abd04-0a3e-4e00-a645-82117159ab75 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-70e6fcd5-3f74-4909-89a1-d65c9807266e req-824abd04-0a3e-4e00-a645-82117159ab75 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-70e6fcd5-3f74-4909-89a1-d65c9807266e req-824abd04-0a3e-4e00-a645-82117159ab75 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:42 user nova-compute[70709]: WARNING nova.compute.manager [req-70e6fcd5-3f74-4909-89a1-d65c9807266e req-824abd04-0a3e-4e00-a645-82117159ab75 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received unexpected event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with vm_state building and task_state spawning.
Jul 28 00:17:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503464.6826382, 159a0ce2-f6b6-45bf-a743-74da642a79fe => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:17:44 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] VM Resumed (Lifecycle Event)
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:17:44 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Instance spawned successfully.
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:17:44 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503464.6842282, 159a0ce2-f6b6-45bf-a743-74da642a79fe => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:17:44 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] VM Started (Lifecycle Event)
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:17:44 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:17:44 user nova-compute[70709]: INFO nova.compute.manager [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Took 5.05 seconds to spawn the instance on the hypervisor.
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-dc0b3c3a-45d4-43a1-b1cf-07581550051a req-9a64f930-be61-4b96-acbf-ae5755cd31ec service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dc0b3c3a-45d4-43a1-b1cf-07581550051a req-9a64f930-be61-4b96-acbf-ae5755cd31ec service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dc0b3c3a-45d4-43a1-b1cf-07581550051a req-9a64f930-be61-4b96-acbf-ae5755cd31ec service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dc0b3c3a-45d4-43a1-b1cf-07581550051a req-9a64f930-be61-4b96-acbf-ae5755cd31ec service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-dc0b3c3a-45d4-43a1-b1cf-07581550051a req-9a64f930-be61-4b96-acbf-ae5755cd31ec service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:44 user nova-compute[70709]: WARNING nova.compute.manager [req-dc0b3c3a-45d4-43a1-b1cf-07581550051a req-9a64f930-be61-4b96-acbf-ae5755cd31ec service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received unexpected event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with vm_state building and task_state spawning.
Jul 28 00:17:44 user nova-compute[70709]: INFO nova.compute.manager [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Took 19.98 seconds to build instance.
Jul 28 00:17:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fa959400-54e4-48c7-9fe5-82e7774160e3 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.124s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:47 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503452.401262, 22b20888-013f-4130-a709-dd7d7932ad80 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:17:47 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] VM Stopped (Lifecycle Event)
Jul 28 00:17:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-50f96555-c594-4ff3-b532-43dfceeabb56 None None] [instance: 22b20888-013f-4130-a709-dd7d7932ad80] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:17:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:56 user nova-compute[70709]: INFO nova.compute.manager [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Terminating instance
Jul 28 00:17:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:17:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-d47b8417-b8fe-4edb-881d-ad6aa8afc0b2 req-14fb5ac2-6733-4d1a-9ac9-c28e2d0b79df service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-vif-unplugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d47b8417-b8fe-4edb-881d-ad6aa8afc0b2 req-14fb5ac2-6733-4d1a-9ac9-c28e2d0b79df service nova] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d47b8417-b8fe-4edb-881d-ad6aa8afc0b2 req-14fb5ac2-6733-4d1a-9ac9-c28e2d0b79df service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d47b8417-b8fe-4edb-881d-ad6aa8afc0b2 req-14fb5ac2-6733-4d1a-9ac9-c28e2d0b79df service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-d47b8417-b8fe-4edb-881d-ad6aa8afc0b2 req-14fb5ac2-6733-4d1a-9ac9-c28e2d0b79df service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] No waiting events found dispatching network-vif-unplugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-d47b8417-b8fe-4edb-881d-ad6aa8afc0b2 req-14fb5ac2-6733-4d1a-9ac9-c28e2d0b79df service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-vif-unplugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:17:57 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Instance destroyed successfully.
Jul 28 00:17:57 user nova-compute[70709]: DEBUG nova.objects.instance [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lazy-loading 'resources' on Instance uuid 4789522e-1b10-41d7-9332-649b5aaf5270 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-330796388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-330796388',id=9,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoBYj2u47hm72HhPB+cTlKzbBr01X98haFYfPWO+EXKwci2MxT+ZwG+mgNy/3QVDHnu7QwR0/IxM01QqzXGpS0obA/XwoFe0OALm1jPCLHs+e/CkiKFa7ONMv9sWpS8gg==',key_name='tempest-keypair-409851532',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:15:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='428557cbe58946ccb2e7afd4bc9c233f',ramdisk_id='',reservation_id='r-6gkdaj2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1986096815',owner_user_name='tempest-TaggedAttachmentsTest-1986096815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fbbbdee1153489ca8062e2dbf4dc5df',uuid=4789522e-1b10-41d7-9332-649b5aaf5270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converting VIF {"id": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "address": "fa:16:3e:44:03:ee", "network": {"id": "f8ffaef5-7148-4019-a274-02eafcaae605", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-184871334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "428557cbe58946ccb2e7afd4bc9c233f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a29154a-ca", "ovs_interfaceid": "3a29154a-ca72-43a4-a111-81c2ac1be6f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:03:ee,bridge_name='br-int',has_traffic_filtering=True,id=3a29154a-ca72-43a4-a111-81c2ac1be6f7,network=Network(f8ffaef5-7148-4019-a274-02eafcaae605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a29154a-ca') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG os_vif [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:03:ee,bridge_name='br-int',has_traffic_filtering=True,id=3a29154a-ca72-43a4-a111-81c2ac1be6f7,network=Network(f8ffaef5-7148-4019-a274-02eafcaae605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a29154a-ca') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a29154a-ca, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:17:57 user nova-compute[70709]: INFO os_vif [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:03:ee,bridge_name='br-int',has_traffic_filtering=True,id=3a29154a-ca72-43a4-a111-81c2ac1be6f7,network=Network(f8ffaef5-7148-4019-a274-02eafcaae605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a29154a-ca')
Jul 28 00:17:57 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Deleting instance files /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270_del
Jul 28 00:17:57 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Deletion of /opt/stack/data/nova/instances/4789522e-1b10-41d7-9332-649b5aaf5270_del complete
Jul 28 00:17:57 user nova-compute[70709]: INFO nova.compute.manager [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 28 00:17:57 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:17:57 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:17:58 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:17:58 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Took 1.16 seconds to deallocate network for instance.
Jul 28 00:17:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-48b603ed-5b59-4387-9b5e-6ba05c4d5ea3 req-412708ed-489b-4613-94ed-f38576d75ed8 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-vif-deleted-3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:58 user nova-compute[70709]: INFO nova.compute.manager [req-48b603ed-5b59-4387-9b5e-6ba05c4d5ea3 req-412708ed-489b-4613-94ed-f38576d75ed8 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Neutron deleted interface 3a29154a-ca72-43a4-a111-81c2ac1be6f7; detaching it from the instance and deleting it from the info cache
Jul 28 00:17:58 user nova-compute[70709]: DEBUG nova.network.neutron [req-48b603ed-5b59-4387-9b5e-6ba05c4d5ea3 req-412708ed-489b-4613-94ed-f38576d75ed8 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:17:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-48b603ed-5b59-4387-9b5e-6ba05c4d5ea3 req-412708ed-489b-4613-94ed-f38576d75ed8 service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Detach interface failed, port_id=3a29154a-ca72-43a4-a111-81c2ac1be6f7, reason: Instance 4789522e-1b10-41d7-9332-649b5aaf5270 could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:17:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-21da8534-4f2c-4375-ad44-a8d8a0f21327 req-9288bbcd-69bb-475a-a563-1cb7b047204f service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received event network-vif-plugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:17:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-21da8534-4f2c-4375-ad44-a8d8a0f21327 req-9288bbcd-69bb-475a-a563-1cb7b047204f service nova] Acquiring lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:17:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-21da8534-4f2c-4375-ad44-a8d8a0f21327 req-9288bbcd-69bb-475a-a563-1cb7b047204f service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:17:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-21da8534-4f2c-4375-ad44-a8d8a0f21327 req-9288bbcd-69bb-475a-a563-1cb7b047204f service nova] Lock "4789522e-1b10-41d7-9332-649b5aaf5270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-21da8534-4f2c-4375-ad44-a8d8a0f21327 req-9288bbcd-69bb-475a-a563-1cb7b047204f service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] No waiting events found dispatching network-vif-plugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:17:59 user nova-compute[70709]: WARNING nova.compute.manager [req-21da8534-4f2c-4375-ad44-a8d8a0f21327 req-9288bbcd-69bb-475a-a563-1cb7b047204f service nova] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Received unexpected event network-vif-plugged-3a29154a-ca72-43a4-a111-81c2ac1be6f7 for instance with vm_state deleted and task_state None.
Jul 28 00:17:59 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:17:59 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:17:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:17:59 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Deleted allocations for instance 4789522e-1b10-41d7-9332-649b5aaf5270
Jul 28 00:17:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-892ee382-e73c-4971-9ebf-ba190f2b2882 tempest-TaggedAttachmentsTest-1986096815 tempest-TaggedAttachmentsTest-1986096815-project-member] Lock "4789522e-1b10-41d7-9332-649b5aaf5270" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.620s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:18:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:18:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:18:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:18:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:18:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'flavor' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:12 user nova-compute[70709]: INFO nova.compute.manager [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Attaching volume 86b782c7-df0d-4e2a-8b05-6dba869dde7c to /dev/vdb
Jul 28 00:18:12 user nova-compute[70709]: DEBUG os_brick.utils [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7850e4ab-6a2c-4e57-85a7-f3659609795f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc0a990-c604-41ad-9c1a-7a7804d73b06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8264a4c-2d38-4e42-9e53-6ddda12c31ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafd74d5-7527-4ce5-92c6-74836885d314]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503477.458926, 4789522e-1b10-41d7-9332-649b5aaf5270 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:12 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] VM Stopped (Lifecycle Event)
Jul 28 00:18:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-03124a6b-d190-404a-9359-12661964c473 None None] [instance: 4789522e-1b10-41d7-9332-649b5aaf5270] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:18:12 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[361e1a1d-3503-4ccc-8679-5e156061a08a]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG os_brick.utils [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating existing volume attachment record: 543fce72-d51d-453a-ab89-00e8552e57f3 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'flavor' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:12 user nova-compute[70709]: INFO nova.compute.manager [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Attaching volume 1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 to /dev/vdb
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:18:12 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG os_brick.utils [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4997c1-951c-48ea-bd58-507f38af6624]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[74325002-99f4-4644-acdc-c69e245d0d6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[644ce90e-915f-4a7d-8338-42d05f41314d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef084d28-365d-44bc-91a3-a26a006207fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:18:13 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c8264e-d918-4194-84a7-1080a559479f]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG os_brick.utils [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updating existing volume attachment record: b6ffc31d-36d1-4dfd-a7d8-2e28a95f4651 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updating instance_info_cache with network_info: [{"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:18:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:18:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7856MB free_disk=25.550559997558594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance df55bbd3-31ab-42f8-9a71-4ed8e3c4428c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 169813c4-7d36-4660-b2fa-4a27fe3e8c86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 3139de03-95b1-4e8a-a15a-886dbd9cfb56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:18:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:18:17 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:18:17 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:18:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:18:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG nova.objects.instance [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'flavor' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:19 user nova-compute[70709]: INFO nova.compute.manager [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Attaching volume 824b06e1-befc-4367-baec-2e5c531a438c to /dev/vdb
Jul 28 00:18:19 user nova-compute[70709]: DEBUG os_brick.utils [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f289d2-279f-42ef-b93f-e4bec99d4b00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98078b8-5e72-437c-9296-de464af1a4f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d261e4dd-3f00-4ce9-a195-61ec6dd6c611]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[babd30a5-d367-4807-ac52-d5dd943c907d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:18:19 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:18:19 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef86847-0cfd-4a72-afdf-4e82b1ec75a4]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG os_brick.utils [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:19 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updating existing volume attachment record: b0c20940-5f1e-469b-bdcc-43cac5503930 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:18:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:22 user nova-compute[70709]: DEBUG nova.objects.instance [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:18:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquired lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:18:22 user nova-compute[70709]: DEBUG nova.network.neutron [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:18:22 user nova-compute[70709]: DEBUG nova.objects.instance [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'info_cache' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaVgHnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:23 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:23 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:23 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe7945d-a851-4a3c-9852-f41ea01de8a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:18:23 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e250c61-b086-4a30-b660-09e5b98d1d7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c] added
Jul 28 00:18:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae025ca-ef00-4280-aa4b-32d533b55459]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbd90f0-41e8-4388-87b7-0032c561dd4f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERaVgHnU {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERaVgHnU" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cded10fa-3b34-4bee-b4b3-132fbe5f0f32]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ERaVgHnU'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a72d4cf-5ca9-42b6-8e5d-aa83278e3f59]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b934831-12be-4551-aaf6-23f7be1fad1a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0721cf3a-b68a-4c2c-a963-088a99afad75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]
Jul 28 00:18:23 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.
Jul 28 00:18:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[31184fe6-f21e-46cf-89db-fd1be174e63f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc6f451-620d-45ee-94b9-a1e62fe11d62]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:23 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:23 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e20e28-1065-4185-89d4-f3ca90c2621f]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updating instance_info_cache with network_info: [{"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:18:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Releasing lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:18:24 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance destroyed successfully.
Jul 28 00:18:24 user nova-compute[70709]: DEBUG nova.objects.instance [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'resources' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2037149563',display_name='tempest-AttachVolumeTestJSON-server-2037149563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2037149563',id=4,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKNEuPphQPlRnxY0JBcdikh9eshk4/9r69y1/MqVTQrHKGifhAnKKVbTQ0Mknn4VbSSaaRD/uIrFnnbFbmKZbFAB4vCxq+B8edPPxFALUWCcXG/5W4U5PVq8d2KDtyakA==',key_name='tempest-keypair-1576770531',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-2xusewnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:16:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=2bb828f4-bb7d-4754-bcaa-38f2954b8eee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_vif [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff3e21e0-da, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:18:24 user nova-compute[70709]: INFO os_vif [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da')
Jul 28 00:18:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnkLoDVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:24 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaVgHnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26461323732373632', 'path': '/dev/sdc'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461323732373632', 'path': '/dev/sdc'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:18:24 user nova-compute[70709]: INFO nova.compute.manager [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Terminating instance
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.663s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG nova.objects.instance [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'flavor' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7573310b-8894-49ae-a4db-69419451ec0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:18:24 user nova-compute[70709]: No targets found.
Jul 28 00:18:24 user nova-compute[70709]: iSNS:
Jul 28 00:18:24 user nova-compute[70709]: No targets found.
Jul 28 00:18:24 user nova-compute[70709]: STATIC:
Jul 28 00:18:24 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:18:24 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:24 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:24 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:18:24 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:24 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:24 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:18:24 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:24 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:24 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:18:24 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:24 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:24 user nova-compute[70709]: FIRMWARE:
Jul 28 00:18:24 user nova-compute[70709]: No targets found.
Jul 28 00:18:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:18:24 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:18:24 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:18:24 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:18:24 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:18:24 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:18:24 user nova-compute[70709]:   <serial>86b782c7-df0d-4e2a-8b05-6dba869dde7c</serial>
Jul 28 00:18:24 user nova-compute[70709]: </disk>
Jul 28 00:18:24 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5d4f89-9ae4-45fd-a774-dc3941f36d3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2660e74-6ef0-4658-9f0e-e05b8201efc8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:24 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:24 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:24 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:24 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:24 user nova-compute[70709]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:24 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b905f75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874'): ({'sde'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Removing single pathed devices sde {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e51498-c746-43c6-b314-ded4662d41b2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f15db2-a40b-4943-981d-76bf74c520e8]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flushing IO for device /dev/sde {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[13759e83-4551-4853-91df-c7cd6a0c8894]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda9d860-a6a8-441f-89ba-64522b33a525]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[39834aa5-204a-4449-9f2f-3dcbd5b4160c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0ed025-a002-47df-bb1e-62ad91b2aec8]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260]
Jul 28 00:18:25 user nova-compute[70709]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260] successful.
Jul 28 00:18:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[921f3513-20ca-4f3d-9170-dfbe51129ee8]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] <== disconnect_volume: return (1073ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Start _get_guest_xml network_info=[{"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'dc1ae311-8d5a-4130-b0b8-eb8006768bc4', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnkLoDVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '2bb828f4-bb7d-4754-bcaa-38f2954b8eee', 'attached_at': '', 'detached_at': '', 'volume_id': 'd16451a8-1aa5-4c9d-9856-f1f0de94a874', 'serial': 'd16451a8-1aa5-4c9d-9856-f1f0de94a874'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.objects.instance [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:25 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:18:25 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-17a849d9-557f-450d-b9eb-591b8a863dc7 req-b7c1c1c2-7ec1-473a-8c2c-ba8aa0b400f4 service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Received event network-vif-unplugged-49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-17a849d9-557f-450d-b9eb-591b8a863dc7 req-b7c1c1c2-7ec1-473a-8c2c-ba8aa0b400f4 service nova] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-17a849d9-557f-450d-b9eb-591b8a863dc7 req-b7c1c1c2-7ec1-473a-8c2c-ba8aa0b400f4 service nova] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-17a849d9-557f-450d-b9eb-591b8a863dc7 req-b7c1c1c2-7ec1-473a-8c2c-ba8aa0b400f4 service nova] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-17a849d9-557f-450d-b9eb-591b8a863dc7 req-b7c1c1c2-7ec1-473a-8c2c-ba8aa0b400f4 service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] No waiting events found dispatching network-vif-unplugged-49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-17a849d9-557f-450d-b9eb-591b8a863dc7 req-b7c1c1c2-7ec1-473a-8c2c-ba8aa0b400f4 service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Received event network-vif-unplugged-49c52655-67de-4f51-ba7d-0ba30b5b137d for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.objects.instance [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnkLoDVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:25 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:25 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:25 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f76d99-f769-4fe2-9c39-e85edec5f286]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:18:25 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] No VIF found with MAC fa:16:3e:58:0f:bc, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce378ac-4ecf-46e5-a5eb-ef131ba172c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874] added
Jul 28 00:18:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2e06c6-1516-4b49-ac2a-9a448c3680de]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[19299fab-8b63-47f6-95d6-f86148b9c070]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnkLoDVE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnkLoDVE" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e11543-69ed-4a5e-8cdf-92cd87e30822]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UnkLoDVE'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[beac246c-a203-4f0b-8a7b-cf069b9698d1]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b0e283-65ab-4b64-9bb8-df402755cfee]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:25 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:25 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:25 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:25 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-21810e39-921c-4d30-947a-5c5f0bb4fa38 tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.207s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1550f44-3167-4d9e-9aa8-e5f501c93041]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260]
Jul 28 00:18:25 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260] successful.
Jul 28 00:18:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Instance destroyed successfully.
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f78a117-1595-44ba-a59b-bc606d3a0551]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.objects.instance [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lazy-loading 'resources' on Instance uuid 169813c4-7d36-4660-b2fa-4a27fe3e8c86 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-792349985',display_name='tempest-TestVolumeSwap-server-792349985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-792349985',id=10,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICUJz/TdunTVrC8/6FVaARXTpCqW2e+Y9lsxnXKZbIADLOAZ+Ikcs9sY/QkRtud7LmRqYYk0uKcjb+ORcrY0snHxsDi8hSsBdfh5nstxZ6rF0V4bB0g+GkJyR/VwAVH6w==',key_name='tempest-keypair-486570714',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:15:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa6125c0be794d138836e1315bfcbb09',ramdisk_id='',reservation_id='r-6s0j3ggi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1753490954',owner_user_name='tempest-TestVolumeSwap-1753490954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e2b4340066e43f79744c5119155f966',uuid=169813c4-7d36-4660-b2fa-4a27fe3e8c86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "address": "fa:16:3e:2b:ad:e1", "network": {"id": "6c016c68-c5f7-4d34-8635-a8a459fb21cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1698481621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6125c0be794d138836e1315bfcbb09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c52655-67", "ovs_interfaceid": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Converting VIF {"id": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "address": "fa:16:3e:2b:ad:e1", "network": {"id": "6c016c68-c5f7-4d34-8635-a8a459fb21cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1698481621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6125c0be794d138836e1315bfcbb09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c52655-67", "ovs_interfaceid": "49c52655-67de-4f51-ba7d-0ba30b5b137d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=49c52655-67de-4f51-ba7d-0ba30b5b137d,network=Network(6c016c68-c5f7-4d34-8635-a8a459fb21cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c52655-67') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_vif [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=49c52655-67de-4f51-ba7d-0ba30b5b137d,network=Network(6c016c68-c5f7-4d34-8635-a8a459fb21cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c52655-67') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49c52655-67, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1793f8-a607-4baa-8e67-1b3db24d79eb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:25 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:25 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:25 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:25 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:25 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:25 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:18:25 user nova-compute[70709]: INFO os_vif [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=49c52655-67de-4f51-ba7d-0ba30b5b137d,network=Network(6c016c68-c5f7-4d34-8635-a8a459fb21cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c52655-67')
Jul 28 00:18:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Deleting instance files /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86_del
Jul 28 00:18:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Deletion of /opt/stack/data/nova/instances/169813c4-7d36-4660-b2fa-4a27fe3e8c86_del complete
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8dcb74-091e-4690-91e3-077ce3757c8f]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnkLoDVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:18:25 user nova-compute[70709]: INFO nova.compute.manager [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 28 00:18:25 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:18:25 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '26661633630346136', 'path': '/dev/sdd'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661633630346136', 'path': '/dev/sdd'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2037149563',display_name='tempest-AttachVolumeTestJSON-server-2037149563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2037149563',id=4,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKNEuPphQPlRnxY0JBcdikh9eshk4/9r69y1/MqVTQrHKGifhAnKKVbTQ0Mknn4VbSSaaRD/uIrFnnbFbmKZbFAB4vCxq+B8edPPxFALUWCcXG/5W4U5PVq8d2KDtyakA==',key_name='tempest-keypair-1576770531',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-2xusewnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:16:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=2bb828f4-bb7d-4754-bcaa-38f2954b8eee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG nova.objects.instance [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:18:26 user nova-compute[70709]:   <uuid>2bb828f4-bb7d-4754-bcaa-38f2954b8eee</uuid>
Jul 28 00:18:26 user nova-compute[70709]:   <name>instance-00000004</name>
Jul 28 00:18:26 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:18:26 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:18:26 user nova-compute[70709]:   <metadata>
Jul 28 00:18:26 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:18:26 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:18:26 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeTestJSON-server-2037149563</nova:name>
Jul 28 00:18:26 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:18:25</nova:creationTime>
Jul 28 00:18:26 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:18:26 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:18:26 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:18:26 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:18:26 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:18:26 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:18:26 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:18:26 user nova-compute[70709]:       <nova:owner>
Jul 28 00:18:26 user nova-compute[70709]:         <nova:user uuid="9c3a7c37bbe542008221fd2bcaf18f5c">tempest-AttachVolumeTestJSON-693253624-project-member</nova:user>
Jul 28 00:18:26 user nova-compute[70709]:         <nova:project uuid="7063760e8f3340f88a0505a3cdcdbf7c">tempest-AttachVolumeTestJSON-693253624</nova:project>
Jul 28 00:18:26 user nova-compute[70709]:       </nova:owner>
Jul 28 00:18:26 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:18:26 user nova-compute[70709]:       <nova:ports>
Jul 28 00:18:26 user nova-compute[70709]:         <nova:port uuid="ff3e21e0-da08-4f60-a9fb-e1a4ea572467">
Jul 28 00:18:26 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 28 00:18:26 user nova-compute[70709]:         </nova:port>
Jul 28 00:18:26 user nova-compute[70709]:       </nova:ports>
Jul 28 00:18:26 user nova-compute[70709]:     </nova:instance>
Jul 28 00:18:26 user nova-compute[70709]:   </metadata>
Jul 28 00:18:26 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:18:26 user nova-compute[70709]:     <system>
Jul 28 00:18:26 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:18:26 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:18:26 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:18:26 user nova-compute[70709]:       <entry name="serial">2bb828f4-bb7d-4754-bcaa-38f2954b8eee</entry>
Jul 28 00:18:26 user nova-compute[70709]:       <entry name="uuid">2bb828f4-bb7d-4754-bcaa-38f2954b8eee</entry>
Jul 28 00:18:26 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:18:26 user nova-compute[70709]:     </system>
Jul 28 00:18:26 user nova-compute[70709]:   </sysinfo>
Jul 28 00:18:26 user nova-compute[70709]:   <os>
Jul 28 00:18:26 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:18:26 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:18:26 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:18:26 user nova-compute[70709]:   </os>
Jul 28 00:18:26 user nova-compute[70709]:   <features>
Jul 28 00:18:26 user nova-compute[70709]:     <acpi/>
Jul 28 00:18:26 user nova-compute[70709]:     <apic/>
Jul 28 00:18:26 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:18:26 user nova-compute[70709]:   </features>
Jul 28 00:18:26 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:18:26 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:18:26 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:18:26 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:18:26 user nova-compute[70709]:   </clock>
Jul 28 00:18:26 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:18:26 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:18:26 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:18:26 user nova-compute[70709]:   </cpu>
Jul 28 00:18:26 user nova-compute[70709]:   <devices>
Jul 28 00:18:26 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:18:26 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:18:26 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk"/>
Jul 28 00:18:26 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:18:26 user nova-compute[70709]:     </disk>
Jul 28 00:18:26 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:18:26 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:18:26 user nova-compute[70709]:       <source dev="/dev/sdd"/>
Jul 28 00:18:26 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:18:26 user nova-compute[70709]:       <serial>d16451a8-1aa5-4c9d-9856-f1f0de94a874</serial>
Jul 28 00:18:26 user nova-compute[70709]:     </disk>
Jul 28 00:18:26 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:18:26 user nova-compute[70709]:       <mac address="fa:16:3e:65:2d:ef"/>
Jul 28 00:18:26 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:18:26 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:18:26 user nova-compute[70709]:       <target dev="tapff3e21e0-da"/>
Jul 28 00:18:26 user nova-compute[70709]:     </interface>
Jul 28 00:18:26 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:18:26 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/console.log" append="off"/>
Jul 28 00:18:26 user nova-compute[70709]:     </serial>
Jul 28 00:18:26 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:18:26 user nova-compute[70709]:     <video>
Jul 28 00:18:26 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:18:26 user nova-compute[70709]:     </video>
Jul 28 00:18:26 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:18:26 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:18:26 user nova-compute[70709]:     </rng>
Jul 28 00:18:26 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:18:26 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:18:26 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:18:26 user nova-compute[70709]:     </memballoon>
Jul 28 00:18:26 user nova-compute[70709]:   </devices>
Jul 28 00:18:26 user nova-compute[70709]: </domain>
Jul 28 00:18:26 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.objects.instance [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:27 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Took 1.46 seconds to deallocate network for instance.
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-27e64dfb-f72d-4a33-80d1-dbae6c097d8c req-b2f565d0-ed1f-4d61-be2d-8777c86fbf0c service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Received event network-vif-plugged-49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-27e64dfb-f72d-4a33-80d1-dbae6c097d8c req-b2f565d0-ed1f-4d61-be2d-8777c86fbf0c service nova] Acquiring lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-27e64dfb-f72d-4a33-80d1-dbae6c097d8c req-b2f565d0-ed1f-4d61-be2d-8777c86fbf0c service nova] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-27e64dfb-f72d-4a33-80d1-dbae6c097d8c req-b2f565d0-ed1f-4d61-be2d-8777c86fbf0c service nova] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-27e64dfb-f72d-4a33-80d1-dbae6c097d8c req-b2f565d0-ed1f-4d61-be2d-8777c86fbf0c service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] No waiting events found dispatching network-vif-plugged-49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:27 user nova-compute[70709]: WARNING nova.compute.manager [req-27e64dfb-f72d-4a33-80d1-dbae6c097d8c req-b2f565d0-ed1f-4d61-be2d-8777c86fbf0c service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Received unexpected event network-vif-plugged-49c52655-67de-4f51-ba7d-0ba30b5b137d for instance with vm_state active and task_state deleting.
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-27e64dfb-f72d-4a33-80d1-dbae6c097d8c req-b2f565d0-ed1f-4d61-be2d-8777c86fbf0c service nova] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Received event network-vif-deleted-49c52655-67de-4f51-ba7d-0ba30b5b137d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.165s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Cannot resize image /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.objects.instance [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'migration_context' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2037149563',display_name='tempest-AttachVolumeTestJSON-server-2037149563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2037149563',id=4,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKNEuPphQPlRnxY0JBcdikh9eshk4/9r69y1/MqVTQrHKGifhAnKKVbTQ0Mknn4VbSSaaRD/uIrFnnbFbmKZbFAB4vCxq+B8edPPxFALUWCcXG/5W4U5PVq8d2KDtyakA==',key_name='tempest-keypair-1576770531',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-2xusewnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:16:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=2bb828f4-bb7d-4754-bcaa-38f2954b8eee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG os_vif [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff3e21e0-da, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff3e21e0-da, col_values=(('external_ids', {'iface-id': 'ff3e21e0-da08-4f60-a9fb-e1a4ea572467', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:2d:ef', 'vm-uuid': '2bb828f4-bb7d-4754-bcaa-38f2954b8eee'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:27 user nova-compute[70709]: INFO os_vif [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da')
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Stashing vm_state: active {{(pid=70709) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 28 00:18:27 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Deleted allocations for instance 169813c4-7d36-4660-b2fa-4a27fe3e8c86
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6aaa6b05-68c0-4d41-a84f-40ac03845307 tempest-TestVolumeSwap-1753490954 tempest-TestVolumeSwap-1753490954-project-member] Lock "169813c4-7d36-4660-b2fa-4a27fe3e8c86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.274s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.objects.instance [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'pci_requests' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:18:28 user nova-compute[70709]: INFO nova.compute.claims [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Claim successful on node user
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.objects.instance [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'resources' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.objects.instance [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'pci_devices' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:28 user nova-compute[70709]: INFO nova.compute.resource_tracker [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating resource usage from migration fd6c45dd-89c9-4228-b535-c46894436656
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.compute.manager [req-6916b908-b906-40f5-b75a-c104be812e3a req-82f9f50f-6d8b-4ec9-9c7c-fc8bd690f166 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Received event network-changed-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.compute.manager [req-6916b908-b906-40f5-b75a-c104be812e3a req-82f9f50f-6d8b-4ec9-9c7c-fc8bd690f166 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Refreshing instance network info cache due to event network-changed-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6916b908-b906-40f5-b75a-c104be812e3a req-82f9f50f-6d8b-4ec9-9c7c-fc8bd690f166 service nova] Acquiring lock "refresh_cache-3139de03-95b1-4e8a-a15a-886dbd9cfb56" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6916b908-b906-40f5-b75a-c104be812e3a req-82f9f50f-6d8b-4ec9-9c7c-fc8bd690f166 service nova] Acquired lock "refresh_cache-3139de03-95b1-4e8a-a15a-886dbd9cfb56" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.network.neutron [req-6916b908-b906-40f5-b75a-c104be812e3a req-82f9f50f-6d8b-4ec9-9c7c-fc8bd690f166 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Refreshing network info cache for port aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.530s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:28 user nova-compute[70709]: INFO nova.compute.manager [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Migrating
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquired lock "compute-rpcapi-router" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:18:28 user nova-compute[70709]: INFO nova.compute.rpcapi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Releasing lock "compute-rpcapi-router" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquired lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.network.neutron [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:28 user nova-compute[70709]: INFO nova.compute.manager [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Terminating instance
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.network.neutron [req-6916b908-b906-40f5-b75a-c104be812e3a req-82f9f50f-6d8b-4ec9-9c7c-fc8bd690f166 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Updated VIF entry in instance network info cache for port aa7bedab-d716-4bf6-9cf0-5f3f40b2b950. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG nova.network.neutron [req-6916b908-b906-40f5-b75a-c104be812e3a req-82f9f50f-6d8b-4ec9-9c7c-fc8bd690f166 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Updating instance_info_cache with network_info: [{"id": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "address": "fa:16:3e:58:8f:1f", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7bedab-d7", "ovs_interfaceid": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6916b908-b906-40f5-b75a-c104be812e3a req-82f9f50f-6d8b-4ec9-9c7c-fc8bd690f166 service nova] Releasing lock "refresh_cache-3139de03-95b1-4e8a-a15a-886dbd9cfb56" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaPrmsKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:29 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:29 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:29 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[677fa4ee-abdc-4cee-a63e-bcc8d0f59a81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:18:29 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd00851-a516-40dc-b74f-f31903245db0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c] added
Jul 28 00:18:29 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b93e177-b5dd-46e4-bcdc-b56f24cb1878]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[da12a0b1-ec97-4cd3-ada1-d27ce241cadc]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OaPrmsKd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OaPrmsKd" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[432648ff-7123-4f44-8dd6-2eb1e04234d5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OaPrmsKd'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d634df-3793-4cfe-b4ad-f9eeab27b4a0]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1806e25e-98d3-4f77-94e0-712c1043b378]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljdBCQOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:29 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f56737c-e3d8-4f61-a0a5-da8afb301600]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c, portal: 172.16.0.220,3260]
Jul 28 00:18:29 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c, portal: 172.16.0.220,3260] successful.
Jul 28 00:18:29 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e9254-757b-4354-9028-6adeaa5f5a8c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[563a2d2f-925c-461a-8396-868180242537]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:29 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:29 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.052s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3d69ef-7ef4-449c-92c3-8447d9e8b737]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaPrmsKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG nova.network.neutron [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating instance_info_cache with network_info: [{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:18:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Releasing lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:18:29 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Instance destroyed successfully.
Jul 28 00:18:29 user nova-compute[70709]: DEBUG nova.objects.instance [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'resources' on Instance uuid 3139de03-95b1-4e8a-a15a-886dbd9cfb56 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-345403129',display_name='tempest-AttachVolumeNegativeTest-server-345403129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-345403129',id=13,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6a2zm4+M9iYAIdeIe6RFMvAvFr+Ckru9lv1wBCxg54rtRuDdEhir0CtK9VwFoOB4jhQDERgAPaqdgQuuGoRX9qafll38RhXx/pBLQZPjSattuPXD6/HetDtK+dZ1Jckg==',key_name='tempest-keypair-1279532060',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:16:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-sbfam4zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=3139de03-95b1-4e8a-a15a-886dbd9cfb56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "address": "fa:16:3e:58:8f:1f", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7bedab-d7", "ovs_interfaceid": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "address": "fa:16:3e:58:8f:1f", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7bedab-d7", "ovs_interfaceid": "aa7bedab-d716-4bf6-9cf0-5f3f40b2b950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:8f:1f,bridge_name='br-int',has_traffic_filtering=True,id=aa7bedab-d716-4bf6-9cf0-5f3f40b2b950,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7bedab-d7') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_vif [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:8f:1f,bridge_name='br-int',has_traffic_filtering=True,id=aa7bedab-d716-4bf6-9cf0-5f3f40b2b950,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7bedab-d7') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa7bedab-d7, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Starting migrate_disk_and_power_off {{(pid=70709) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 28 00:18:30 user nova-compute[70709]: INFO os_vif [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:8f:1f,bridge_name='br-int',has_traffic_filtering=True,id=aa7bedab-d716-4bf6-9cf0-5f3f40b2b950,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7bedab-d7')
Jul 28 00:18:30 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Deleting instance files /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56_del
Jul 28 00:18:30 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Deletion of /opt/stack/data/nova/instances/3139de03-95b1-4e8a-a15a-886dbd9cfb56_del complete
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:30 user nova-compute[70709]: INFO nova.compute.manager [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Took 1.35 seconds to destroy the instance on the hypervisor.
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Received event network-vif-unplugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Acquiring lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] No waiting events found dispatching network-vif-unplugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Received event network-vif-unplugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Received event network-vif-plugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Acquiring lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] No waiting events found dispatching network-vif-plugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:30 user nova-compute[70709]: WARNING nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Received unexpected event network-vif-plugged-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 for instance with vm_state active and task_state deleting.
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:30 user nova-compute[70709]: WARNING nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received unexpected event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with vm_state stopped and task_state powering-on.
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:30 user nova-compute[70709]: WARNING nova.compute.manager [req-694fbc4d-82a9-47be-a8e8-b0beac755ec1 req-52fbef09-5b00-4dda-a906-b1c8cf8a5b42 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received unexpected event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with vm_state stopped and task_state powering-on.
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.517s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] <== connect_volume: return (1520ms) {'type': 'block', 'scsi_wwn': '26661616630396439', 'path': '/dev/sde'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661616630396439', 'path': '/dev/sde'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.229s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:30 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:30 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.objects.instance [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'flavor' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[58435a63-ec86-4562-a9ec-50eeb2e5eb68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:18:30 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[156ecf24-0db0-4126-8663-3b4f1c4e5c2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0] added
Jul 28 00:18:30 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:18:30 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:18:30 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:18:30 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:18:30 user nova-compute[70709]:   <serial>824b06e1-befc-4367-baec-2e5c531a438c</serial>
Jul 28 00:18:30 user nova-compute[70709]: </disk>
Jul 28 00:18:30 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c4c40a-8585-40ac-98cc-3dc55573c2d5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde93264-2992-4774-91c8-f3a93343bd2f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljdBCQOJ {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljdBCQOJ" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddab333-cf60-4490-874a-c043ff143ba7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ljdBCQOJ'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[85909b9e-ad88-415a-adb5-a33090bba86a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a4f8a4-96c5-4d11-a101-2054f5dce7cd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:30 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:30 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:30 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:30 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:30 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:30 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:30 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:30 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:30 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:30 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a9e097-49f5-44c6-bf8e-7dda6cf25cab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260]
Jul 28 00:18:30 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260] successful.
Jul 28 00:18:30 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.139s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fa260d-9eda-4ae5-96ea-bca0e9b98dd3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9ead54-8c24-4edd-abe9-90417fc266b3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:31 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:31 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:31 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:31 user nova-compute[70709]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:31 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:31 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:31 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:31 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:31 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:31 user nova-compute[70709]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:31 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:31 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.541s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad8fe0d-6933-4c69-8a61-89e516e819a7]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljdBCQOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:18:31 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance destroyed successfully.
Jul 28 00:18:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1488928010',display_name='tempest-ServerActionsTestOtherB-server-1488928010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1488928010',id=3,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnNPKIDRaM81k628x28KRrACS+k9io0IYMr8rKnbfV6R9PEGedJ0uPueig7JixSq/MVd5cruSs8PGo9MLWndddj6j9yk5HzD1hsNyADvhHRJFhgOMMfk3L2UUGGtvzDbA==',key_name='tempest-keypair-458737518',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8a7ed8f269b4e989727baa24619d774',ramdisk_id='',reservation_id='r-0vm06iql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900188209',owner_user_name='tempest-ServerActionsTestOtherB-1900188209-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc9412c0c5a345399b7cc2ff4540535d',uuid=df55bbd3-31ab-42f8-9a71-4ed8e3c4428c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1008293406-network", "vif_mac": "fa:16:3e:58:0f:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converting VIF {"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1008293406-network", "vif_mac": "fa:16:3e:58:0f:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_vif [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e92340f-f9, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:18:31 user nova-compute[70709]: INFO os_vif [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9')
Jul 28 00:18:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaVgHnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:31 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] No VIF found with MAC fa:16:3e:03:3a:3b, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:18:31 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Took 1.26 seconds to deallocate network for instance.
Jul 28 00:18:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-5cc0a62b-98b0-4a00-867a-7077d9784d49 req-022bcd90-723c-4258-99f3-183680d63a17 service nova] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Received event network-vif-deleted-aa7bedab-d716-4bf6-9cf0-5f3f40b2b950 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3557626b-e54e-4017-9324-34408c8d8b2c tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.948s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:18:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:32 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Deleted allocations for instance 3139de03-95b1-4e8a-a15a-886dbd9cfb56
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66bb1fb0-d6f4-4635-9ebb-f8f5a8f01780 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "3139de03-95b1-4e8a-a15a-886dbd9cfb56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.275s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.602s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== connect_volume: return (2832ms) {'type': 'block', 'scsi_wwn': '23730353831366666', 'path': '/dev/sdg'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730353831366666', 'path': '/dev/sdg'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.907s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.objects.instance [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'flavor' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[df74c795-d1a1-48ac-9293-3e1652518694]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:18:32 user nova-compute[70709]: No targets found.
Jul 28 00:18:32 user nova-compute[70709]: iSNS:
Jul 28 00:18:32 user nova-compute[70709]: No targets found.
Jul 28 00:18:32 user nova-compute[70709]: STATIC:
Jul 28 00:18:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:18:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:18:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c
Jul 28 00:18:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:18:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:18:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:32 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0
Jul 28 00:18:32 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:32 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:32 user nova-compute[70709]: FIRMWARE:
Jul 28 00:18:32 user nova-compute[70709]: No targets found.
Jul 28 00:18:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:18:32 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:18:32 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:18:32 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:18:32 user nova-compute[70709]:   <source dev="/dev/sdg"/>
Jul 28 00:18:32 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:18:32 user nova-compute[70709]:   <serial>1d66a522-ca12-42a5-9cf4-e81ca64c1cd0</serial>
Jul 28 00:18:32 user nova-compute[70709]: </disk>
Jul 28 00:18:32 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8fdca4-98f5-45f0-93f7-57adbb3b1ef7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb3ec3b-1764-454f-aad4-c8650717581e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:32 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:32 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:32 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:32 user nova-compute[70709]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:32 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:32 user nova-compute[70709]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:32 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:32 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:32 user nova-compute[70709]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:32 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90588820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c'): ({'sdc'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Removing single pathed devices sdc {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8c1c62-5be5-49f2-aaf1-e6666f041838]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[134f3b75-ac0e-429e-a4b8-ea6802c9251b]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Flushing IO for device /dev/sdc {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503512.3417957, 2bb828f4-bb7d-4754-bcaa-38f2954b8eee => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:32 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] VM Resumed (Lifecycle Event)
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e47562e-b80b-43b2-ad6e-59e59326add6]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance rebooted successfully.
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-496b5246-f5ad-447b-b2e8-c434050bc0d3 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:18:32 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503512.342016, 2bb828f4-bb7d-4754-bcaa-38f2954b8eee => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:32 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] VM Started (Lifecycle Event)
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[587ee04e-1dc7-4071-a7ab-4a17ca9432bb]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eb730d-ac5b-4bb3-982f-12ee872dc4d3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecd9700-6b8f-4419-9272-4f522eb39b99]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]
Jul 28 00:18:32 user nova-compute[70709]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.
Jul 28 00:18:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-unplugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-unplugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:32 user nova-compute[70709]: WARNING nova.compute.manager [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received unexpected event network-vif-unplugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with vm_state active and task_state resize_migrating.
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:32 user nova-compute[70709]: WARNING nova.compute.manager [req-242d31f3-0464-46ef-b0ad-a25f66f28c97 req-49f697ec-1899-4e4b-b675-474737e3c455 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received unexpected event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with vm_state active and task_state resize_migrating.
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d11c6-bd83-4653-9441-175114e94f26]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] <== disconnect_volume: return (1319ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No VIF found with MAC fa:16:3e:4a:f3:cb, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:18:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c_resize/disk /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-01097eee-e72a-42fc-b266-aa673d973676 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.171s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:33 user nova-compute[70709]: INFO nova.compute.manager [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Rescuing
Jul 28 00:18:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:18:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquired lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:18:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:18:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "cp -r /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c_resize/disk /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk" returned: 0 in 0.460s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c_resize/disk.info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk.info {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "cp -r /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c_resize/disk.info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk.info" returned: 0 in 0.042s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updating instance_info_cache with network_info: [{"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:18:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Releasing lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "8168aa39-afce-4c9e-ba76-78a760767357" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.compute.manager [req-4e74a6bf-bf95-4215-bd1f-adaa09f87b83 req-3b09879d-8074-459c-b4d3-436598a026be service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-unplugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4e74a6bf-bf95-4215-bd1f-adaa09f87b83 req-3b09879d-8074-459c-b4d3-436598a026be service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4e74a6bf-bf95-4215-bd1f-adaa09f87b83 req-3b09879d-8074-459c-b4d3-436598a026be service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4e74a6bf-bf95-4215-bd1f-adaa09f87b83 req-3b09879d-8074-459c-b4d3-436598a026be service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.compute.manager [req-4e74a6bf-bf95-4215-bd1f-adaa09f87b83 req-3b09879d-8074-459c-b4d3-436598a026be service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-unplugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:34 user nova-compute[70709]: WARNING nova.compute.manager [req-4e74a6bf-bf95-4215-bd1f-adaa09f87b83 req-3b09879d-8074-459c-b4d3-436598a026be service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received unexpected event network-vif-unplugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with vm_state active and task_state rescuing.
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:18:34 user nova-compute[70709]: INFO nova.compute.claims [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Claim successful on node user
Jul 28 00:18:34 user nova-compute[70709]: INFO nova.compute.manager [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Rebuilding instance
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'trusted_certs' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:34 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Instance destroyed successfully.
Jul 28 00:18:34 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Attempting a stable device rescue
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'pci_requests' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=70709) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'pci_devices' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Instance directory exists: not creating {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 28 00:18:34 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Creating image(s)
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "/opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "/opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "/opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'trusted_certs' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'resources' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "0336f29a99fca21c521c0131f551e2cc3425bd42" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "0336f29a99fca21c521c0131f551e2cc3425bd42" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'migration_context' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70709) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42.part --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:36 user nova-compute[70709]: WARNING nova.compute.manager [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received unexpected event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with vm_state active and task_state rescuing.
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-vif-unplugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] No waiting events found dispatching network-vif-unplugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:36 user nova-compute[70709]: WARNING nova.compute.manager [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received unexpected event network-vif-unplugged-ee9a657a-7c7d-4849-8394-9438487032f9 for instance with vm_state active and task_state rebuilding.
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] No waiting events found dispatching network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:36 user nova-compute[70709]: WARNING nova.compute.manager [req-8c0e5b24-1980-4419-9b0c-abfa7b1ef2ee req-c25f8cda-1d01-4a68-853e-572019e8031b service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received unexpected event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 for instance with vm_state active and task_state rebuilding.
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.compute.manager [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.network.neutron [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:18:36 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Instance destroyed successfully.
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42.part --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.virt.images [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] 1a2d2542-b136-42da-8162-d06c557f9805 was qcow2, converting to raw {{(pid=70709) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42.part /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42.converted {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.policy [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1ee7cb9ed044e10a022b23f51bcb588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1181361da7694becb7e59b4b47eb0760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:18:36 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:18:36 user nova-compute[70709]: DEBUG nova.compute.manager [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:18:36 user nova-compute[70709]: INFO nova.compute.manager [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Detaching volume 1d66a522-ca12-42a5-9cf4-e81ca64c1cd0
Jul 28 00:18:37 user nova-compute[70709]: INFO nova.virt.block_device [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Attempting to driver detach volume 1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 from mountpoint /dev/vdb
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Attempting to detach device vdb from instance b61aaab4-ca86-41e6-a576-a7174d89a284 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:18:37 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:18:37 user nova-compute[70709]:   <source dev="/dev/sdg"/>
Jul 28 00:18:37 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:18:37 user nova-compute[70709]:   <serial>1d66a522-ca12-42a5-9cf4-e81ca64c1cd0</serial>
Jul 28 00:18:37 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:18:37 user nova-compute[70709]: </disk>
Jul 28 00:18:37 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42.part /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42.converted" returned: 0 in 0.459s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42.converted --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.network.neutron [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Port 7e92340f-f93d-411f-8e69-2a75164b3679 binding to destination host user is already ACTIVE {{(pid=70709) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:18:37 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Creating image(s)
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "/opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "/opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "/opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Successfully detached device vdb from instance b61aaab4-ca86-41e6-a576-a7174d89a284 from the persistent domain config.
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljdBCQOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:37 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "0336f29a99fca21c521c0131f551e2cc3425bd42" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.271s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "0336f29a99fca21c521c0131f551e2cc3425bd42" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "0336f29a99fca21c521c0131f551e2cc3425bd42" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd5d86f-3ef2-49be-a651-c0b7762b5a44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:18:37 user nova-compute[70709]: No targets found.
Jul 28 00:18:37 user nova-compute[70709]: iSNS:
Jul 28 00:18:37 user nova-compute[70709]: No targets found.
Jul 28 00:18:37 user nova-compute[70709]: STATIC:
Jul 28 00:18:37 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:18:37 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:37 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:37 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c
Jul 28 00:18:37 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:37 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:37 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:18:37 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:37 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:37 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:18:37 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:37 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:37 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0
Jul 28 00:18:37 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:37 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:37 user nova-compute[70709]: FIRMWARE:
Jul 28 00:18:37 user nova-compute[70709]: No targets found.
Jul 28 00:18:37 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:18:37 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:18:37 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd0063f-82ed-49b3-9e6d-df3381b51ecf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42 --force-share --output=json" returned: 0 in 0.186s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42,backing_fmt=raw /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.rescue {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ab65d6-2ec6-4864-99d7-99ba4096321e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:37 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:37 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:37 user nova-compute[70709]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:37 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:37 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:37 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:37 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:37 user nova-compute[70709]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:37 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:37 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90274670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0'): ({'sdg'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Removing single pathed devices sdg {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.186s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42,backing_fmt=raw /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.rescue" returned: 0 in 0.109s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedb012e-cb9a-484e-b379-5386ffe12b21]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "0336f29a99fca21c521c0131f551e2cc3425bd42" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'migration_context' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk 1073741824" returned: 0 in 0.070s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc75a8c0-6b85-40a6-8141-dd7fae09fc22]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Start _get_guest_xml network_info=[{"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "vif_mac": "fa:16:3e:03:3a:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1a2d2542-b136-42da-8162-d06c557f9805', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'b0c20940-5f1e-469b-bdcc-43cac5503930', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaPrmsKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a585b419-b9f5-4bd6-bbc9-cdfc4e732712', 'attached_at': '', 'detached_at': '', 'volume_id': '824b06e1-befc-4367-baec-2e5c531a438c', 'serial': '824b06e1-befc-4367-baec-2e5c531a438c'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'resources' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flushing IO for device /dev/sdg {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.network.neutron [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Successfully created port: b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a97bf39-3c94-469e-9947-90f4c0b8ee92]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'numa_topology' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquired lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.network.neutron [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:18:37 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:18:37 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'vcpu_model' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.064s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[609aa27e-5793-4df0-8696-4f5687ccc48f]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] SCSI volumes sdg have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaPrmsKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:37 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5c1113-aaf5-4315-8fdd-fd9cadae1afd]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.190s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be4eada-18f3-4292-904a-b2c21230e951]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260]
Jul 28 00:18:37 user nova-compute[70709]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260] successful.
Jul 28 00:18:37 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32dca13-b3c9-42d4-be5b-db9110ee2eff]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.686s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== disconnect_volume: return (689ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.158s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:37 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:37 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Cannot resize image /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.objects.instance [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lazy-loading 'migration_context' on Instance uuid 8168aa39-afce-4c9e-ba76-78a760767357 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Ensure instance console log exists: /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7779a1eb-409d-4414-855d-7363d8599a81]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OaPrmsKd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 28 00:18:37 user nova-compute[70709]: node.name = iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c
Jul 28 00:18:37 user nova-compute[70709]: node.tpgt = -1
Jul 28 00:18:37 user nova-compute[70709]: node.startup = automatic
Jul 28 00:18:37 user nova-compute[70709]: node.leading_login = No
Jul 28 00:18:37 user nova-compute[70709]: iface.iscsi_ifacename = default
Jul 28 00:18:37 user nova-compute[70709]: iface.net_ifacename = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.ipaddress = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.prefix_len = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.hwaddress = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.transport_name = tcp
Jul 28 00:18:37 user nova-compute[70709]: iface.initiatorname = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.state = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.vlan_id = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.vlan_priority = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.vlan_state = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.iface_num = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.mtu = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.port = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.bootproto = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.subnet_mask = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.gateway = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.dhcp_alt_client_id_state = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.dhcp_alt_client_id = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.dhcp_dns = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.dhcp_learn_iqn = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.dhcp_req_vendor_id_state = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.dhcp_vendor_id_state = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.dhcp_vendor_id = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.dhcp_slp_da = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.fragmentation = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.gratuitous_arp = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.incoming_forwarding = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.tos_state = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.tos = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.ttl = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.delayed_ack = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.tcp_nagle = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.tcp_wsf_state = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.tcp_wsf = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.tcp_timer_scale = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.tcp_timestamp = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.redirect = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.def_task_mgmt_timeout = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.header_digest = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.data_digest = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.immediate_data = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.initial_r2t = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.data_seq_inorder = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.data_pdu_inorder = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.erl = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.max_receive_data_len = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.first_burst_len = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.max_outstanding_r2t = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.max_burst_len = 0
Jul 28 00:18:37 user nova-compute[70709]: iface.chap_auth = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.bidi_chap = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.strict_login_compliance = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.discovery_auth = <empty>
Jul 28 00:18:37 user nova-compute[70709]: iface.discovery_logout = <empty>
Jul 28 00:18:37 user nova-compute[70709]: node.discovery_address = <empty>
Jul 28 00:18:37 user nova-compute[70709]: node.discovery_port = 0
Jul 28 00:18:37 user nova-compute[70709]: node.discovery_type = static
Jul 28 00:18:37 user nova-compute[70709]: node.session.initial_cmdsn = 0
Jul 28 00:18:37 user nova-compute[70709]: node.session.initial_login_retry_max = 8
Jul 28 00:18:37 user nova-compute[70709]: node.session.xmit_thread_priority = -20
Jul 28 00:18:37 user nova-compute[70709]: node.session.cmds_max = 128
Jul 28 00:18:37 user nova-compute[70709]: node.session.queue_depth = 32
Jul 28 00:18:37 user nova-compute[70709]: node.session.nr_sessions = 1
Jul 28 00:18:37 user nova-compute[70709]: node.session.auth.authmethod = CHAP
Jul 28 00:18:37 user nova-compute[70709]: node.session.auth.username = OaPrmsKd
Jul 28 00:18:37 user nova-compute[70709]: node.session.auth.password = ***
Jul 28 00:18:37 user nova-compute[70709]: node.session.auth.username_in = <empty>
Jul 28 00:18:37 user nova-compute[70709]: node.session.auth.password_in = <empty>
Jul 28 00:18:37 user nova-compute[70709]: node.session.auth.chap_algs = MD5
Jul 28 00:18:37 user nova-compute[70709]: node.session.timeo.replacement_timeout = 120
Jul 28 00:18:37 user nova-compute[70709]: node.session.err_timeo.abort_timeout = 15
Jul 28 00:18:37 user nova-compute[70709]: node.session.err_timeo.lu_reset_timeout = 30
Jul 28 00:18:37 user nova-compute[70709]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 28 00:18:37 user nova-compute[70709]: node.session.err_timeo.host_reset_timeout = 60
Jul 28 00:18:37 user nova-compute[70709]: node.session.iscsi.FastAbort = Yes
Jul 28 00:18:37 user nova-compute[70709]: node.session.iscsi.InitialR2T = No
Jul 28 00:18:37 user nova-compute[70709]: node.session.iscsi.ImmediateData = Yes
Jul 28 00:18:37 user nova-compute[70709]: node.session.iscsi.FirstBurstLength = 262144
Jul 28 00:18:37 user nova-compute[70709]: node.session.iscsi.MaxBurstLength = 16776192
Jul 28 00:18:37 user nova-compute[70709]: node.session.iscsi.DefaultTime2Retain = 0
Jul 28 00:18:37 user nova-compute[70709]: node.session.iscsi.DefaultTime2Wait = 2
Jul 28 00:18:37 user nova-compute[70709]: node.session.iscsi.MaxConnections = 1
Jul 28 00:18:37 user nova-compute[70709]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 28 00:18:37 user nova-compute[70709]: node.session.iscsi.ERL = 0
Jul 28 00:18:37 user nova-compute[70709]: node.session.scan = manual
Jul 28 00:18:37 user nova-compute[70709]: node.session.reopen_max = 0
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].address = 172.16.0.220
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].port = 3260
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].startup = manual
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].tcp.window_size = 524288
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].tcp.type_of_service = 0
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].timeo.logout_timeout = 15
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].timeo.login_timeout = 15
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].timeo.auth_timeout = 45
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].timeo.noop_out_interval = 5
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].timeo.noop_out_timeout = 5
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].iscsi.HeaderDigest = None
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].iscsi.DataDigest = None
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].iscsi.IFMarker = No
Jul 28 00:18:37 user nova-compute[70709]: node.conn[0].iscsi.OFMarker = No
Jul 28 00:18:37 user nova-compute[70709]: # END RECORD
Jul 28 00:18:37 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3823910-b80d-4992-85fa-6cb90e6c56be]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc983ea-f33a-4af4-b76e-2bd50618a713]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OaPrmsKd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OaPrmsKd" returned: 0 in 0.039s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9569333-68b3-4a8b-ba47-765ac3ad9a19]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OaPrmsKd'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccef24f-7c6e-49c9-a13f-71972f5c9254]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb94ba1-c43e-4c8e-a703-200875b133fa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:38 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:38 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:38 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:38 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:38 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:38 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] HCTL ('36', '0', '0', 0) found on session 16 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba16a27-a543-4141-bca4-2ccfddd6dcc6]: (4, ('0 0 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Searching for a device in session 16 and hctl ('36', '0', '0', 0) yield: sde {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaPrmsKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.269s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] <== connect_volume: return (428ms) {'type': 'block', 'scsi_wwn': '26661616630396439', 'path': '/dev/sde'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661616630396439', 'path': '/dev/sde'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1549359080',display_name='tempest-ServerStableDeviceRescueTest-server-1549359080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1549359080',id=7,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwy4HneA3ZUmeqPHrbQse+qJUWEhfXTEMPBGDoaqxhrehEEkFn9HOsG11LJXknhyS0mntTrtVk8HXwWH6XqWK8W1vLqidE4n9cl+QqPNrxj8k61BRJMpjdt4hxKUVAzog==',key_name='tempest-keypair-154217269',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f49049f887a4601b9788b7929269749',ramdisk_id='',reservation_id='r-cg2emlcr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-292119774',owner_user_name='tempest-ServerStableDeviceRescueTest-292119774-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4bdf96671af4dcd81161e222a396d2e',uuid=a585b419-b9f5-4bd6-bbc9-cdfc4e732712,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "vif_mac": "fa:16:3e:03:3a:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Converting VIF {"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "vif_mac": "fa:16:3e:03:3a:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:3a:3b,bridge_name='br-int',has_traffic_filtering=True,id=84dc7a3e-6f63-4ff1-8689-38f607df3ae6,network=Network(de8b5a09-458a-445c-b0f7-21e454cb5d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc7a3e-6f') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'pci_devices' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:18:38 user nova-compute[70709]:   <uuid>a585b419-b9f5-4bd6-bbc9-cdfc4e732712</uuid>
Jul 28 00:18:38 user nova-compute[70709]:   <name>instance-00000007</name>
Jul 28 00:18:38 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:18:38 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:18:38 user nova-compute[70709]:   <metadata>
Jul 28 00:18:38 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:18:38 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:18:38 user nova-compute[70709]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1549359080</nova:name>
Jul 28 00:18:38 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:18:37</nova:creationTime>
Jul 28 00:18:38 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:18:38 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:18:38 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:18:38 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:18:38 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:18:38 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:18:38 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:18:38 user nova-compute[70709]:       <nova:owner>
Jul 28 00:18:38 user nova-compute[70709]:         <nova:user uuid="f4bdf96671af4dcd81161e222a396d2e">tempest-ServerStableDeviceRescueTest-292119774-project-member</nova:user>
Jul 28 00:18:38 user nova-compute[70709]:         <nova:project uuid="5f49049f887a4601b9788b7929269749">tempest-ServerStableDeviceRescueTest-292119774</nova:project>
Jul 28 00:18:38 user nova-compute[70709]:       </nova:owner>
Jul 28 00:18:38 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:18:38 user nova-compute[70709]:       <nova:ports>
Jul 28 00:18:38 user nova-compute[70709]:         <nova:port uuid="84dc7a3e-6f63-4ff1-8689-38f607df3ae6">
Jul 28 00:18:38 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 28 00:18:38 user nova-compute[70709]:         </nova:port>
Jul 28 00:18:38 user nova-compute[70709]:       </nova:ports>
Jul 28 00:18:38 user nova-compute[70709]:     </nova:instance>
Jul 28 00:18:38 user nova-compute[70709]:   </metadata>
Jul 28 00:18:38 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:18:38 user nova-compute[70709]:     <system>
Jul 28 00:18:38 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:18:38 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:18:38 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:18:38 user nova-compute[70709]:       <entry name="serial">a585b419-b9f5-4bd6-bbc9-cdfc4e732712</entry>
Jul 28 00:18:38 user nova-compute[70709]:       <entry name="uuid">a585b419-b9f5-4bd6-bbc9-cdfc4e732712</entry>
Jul 28 00:18:38 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:18:38 user nova-compute[70709]:     </system>
Jul 28 00:18:38 user nova-compute[70709]:   </sysinfo>
Jul 28 00:18:38 user nova-compute[70709]:   <os>
Jul 28 00:18:38 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:18:38 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:18:38 user nova-compute[70709]:   </os>
Jul 28 00:18:38 user nova-compute[70709]:   <features>
Jul 28 00:18:38 user nova-compute[70709]:     <acpi/>
Jul 28 00:18:38 user nova-compute[70709]:     <apic/>
Jul 28 00:18:38 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:18:38 user nova-compute[70709]:   </features>
Jul 28 00:18:38 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:18:38 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:18:38 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:18:38 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:18:38 user nova-compute[70709]:   </clock>
Jul 28 00:18:38 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:18:38 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:18:38 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:18:38 user nova-compute[70709]:   </cpu>
Jul 28 00:18:38 user nova-compute[70709]:   <devices>
Jul 28 00:18:38 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:18:38 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:18:38 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk"/>
Jul 28 00:18:38 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:18:38 user nova-compute[70709]:     </disk>
Jul 28 00:18:38 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:18:38 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:18:38 user nova-compute[70709]:       <source dev="/dev/sde"/>
Jul 28 00:18:38 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:18:38 user nova-compute[70709]:       <serial>824b06e1-befc-4367-baec-2e5c531a438c</serial>
Jul 28 00:18:38 user nova-compute[70709]:     </disk>
Jul 28 00:18:38 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:18:38 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:18:38 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.rescue"/>
Jul 28 00:18:38 user nova-compute[70709]:       <target dev="vdc" bus="virtio"/>
Jul 28 00:18:38 user nova-compute[70709]:       <boot order="1"/>
Jul 28 00:18:38 user nova-compute[70709]:     </disk>
Jul 28 00:18:38 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:18:38 user nova-compute[70709]:       <mac address="fa:16:3e:03:3a:3b"/>
Jul 28 00:18:38 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:18:38 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:18:38 user nova-compute[70709]:       <target dev="tap84dc7a3e-6f"/>
Jul 28 00:18:38 user nova-compute[70709]:     </interface>
Jul 28 00:18:38 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:18:38 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/console.log" append="off"/>
Jul 28 00:18:38 user nova-compute[70709]:     </serial>
Jul 28 00:18:38 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:18:38 user nova-compute[70709]:     <video>
Jul 28 00:18:38 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:18:38 user nova-compute[70709]:     </video>
Jul 28 00:18:38 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:18:38 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:18:38 user nova-compute[70709]:     </rng>
Jul 28 00:18:38 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:18:38 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:18:38 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:18:38 user nova-compute[70709]:     </memballoon>
Jul 28 00:18:38 user nova-compute[70709]:   </devices>
Jul 28 00:18:38 user nova-compute[70709]: </domain>
Jul 28 00:18:38 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:18:38 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Instance destroyed successfully.
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] No VIF found with MAC fa:16:3e:03:3a:3b, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating instance_info_cache with network_info: [{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Releasing lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.utils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6cb151-6ccb-4d3f-be19-f3a0bab478d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c82b62-13c1-48af-8d07-050ddf49e8f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4e498a-560c-431d-8ca3-230bc3c8c321]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6d9fec-87b7-4f76-8de7-bacd484a191d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Successfully updated port: b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:18:38 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4561b117-a879-4a2b-b6f1-2bfe7a9f6e8d]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG os_brick.utils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "refresh_cache-8168aa39-afce-4c9e-ba76-78a760767357" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquired lock "refresh_cache-8168aa39-afce-4c9e-ba76-78a760767357" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-3cfa4919-53ab-4722-a99e-46e88b5282d3 req-ce496e41-7e82-4365-9d04-9d469ae46457 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Received event network-changed-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-3cfa4919-53ab-4722-a99e-46e88b5282d3 req-ce496e41-7e82-4365-9d04-9d469ae46457 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Refreshing instance network info cache due to event network-changed-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:18:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3cfa4919-53ab-4722-a99e-46e88b5282d3 req-ce496e41-7e82-4365-9d04-9d469ae46457 service nova] Acquiring lock "refresh_cache-8168aa39-afce-4c9e-ba76-78a760767357" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.network.neutron [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:18:39 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Instance destroyed successfully.
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1529008866',display_name='tempest-ServerActionsTestOtherA-server-1351361021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1529008866',id=2,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-ekq6qgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:18:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b61aaab4-ca86-41e6-a576-a7174d89a284,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_vif [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee9a657a-7c, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:39 user nova-compute[70709]: INFO os_vif [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c')
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljdBCQOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:39 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2e606e-370c-47c3-a53c-9923de4bbade]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:18:39 user nova-compute[70709]: No targets found.
Jul 28 00:18:39 user nova-compute[70709]: iSNS:
Jul 28 00:18:39 user nova-compute[70709]: No targets found.
Jul 28 00:18:39 user nova-compute[70709]: STATIC:
Jul 28 00:18:39 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:18:39 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:39 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:39 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c
Jul 28 00:18:39 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:39 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:39 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:18:39 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:39 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:39 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:18:39 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:18:39 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:18:39 user nova-compute[70709]: FIRMWARE:
Jul 28 00:18:39 user nova-compute[70709]: No targets found.
Jul 28 00:18:39 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:18:39 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:18:39 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fb846b-f224-4dde-86fa-3c33ebc0cf5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c63f76-654b-4b4d-9856-5d692f899745]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:39 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:39 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:39 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:39 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:39 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:39 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:39 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:39 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90175750>, {}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Disconnecting from: [] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.103s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== disconnect_volume: return (105ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:18:39 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Deleting instance files /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284_del
Jul 28 00:18:39 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Deletion of /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284_del complete
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.network.neutron [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Updating instance_info_cache with network_info: [{"id": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "address": "fa:16:3e:41:8c:f9", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a39ad7-b4", "ovs_interfaceid": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Releasing lock "refresh_cache-8168aa39-afce-4c9e-ba76-78a760767357" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Instance network_info: |[{"id": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "address": "fa:16:3e:41:8c:f9", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a39ad7-b4", "ovs_interfaceid": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3cfa4919-53ab-4722-a99e-46e88b5282d3 req-ce496e41-7e82-4365-9d04-9d469ae46457 service nova] Acquired lock "refresh_cache-8168aa39-afce-4c9e-ba76-78a760767357" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.network.neutron [req-3cfa4919-53ab-4722-a99e-46e88b5282d3 req-ce496e41-7e82-4365-9d04-9d469ae46457 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Refreshing network info cache for port b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Start _get_guest_xml network_info=[{"id": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "address": "fa:16:3e:41:8c:f9", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a39ad7-b4", "ovs_interfaceid": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:18:39 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:18:39 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:18:39 user nova-compute[70709]: INFO nova.virt.block_device [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Booting with volume 1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 at /dev/vdb
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-112387795',display_name='tempest-VolumesAdminNegativeTest-server-112387795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-112387795',id=15,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvxeCpoXyL4L/QGhEY0hwn6ca64Hgg+xkpCkOoFCbEILR2mSCAw20ll9UF+zLLNy3TqdK4RBtK9fzupjseRBhV7tRR33zFBMFP0a22zV0z999om01KaPV7ZDDB7fpLnKg==',key_name='tempest-keypair-263863682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1181361da7694becb7e59b4b47eb0760',ramdisk_id='',reservation_id='r-im8d98vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-945099691',owner_user_name='tempest-VolumesAdminNegativeTest-945099691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1ee7cb9ed044e10a022b23f51bcb588',uuid=8168aa39-afce-4c9e-ba76-78a760767357,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "address": "fa:16:3e:41:8c:f9", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a39ad7-b4", "ovs_interfaceid": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converting VIF {"id": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "address": "fa:16:3e:41:8c:f9", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a39ad7-b4", "ovs_interfaceid": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:8c:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3a39ad7-b4fb-42f8-afc2-038ad99f2f47,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a39ad7-b4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.objects.instance [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lazy-loading 'pci_devices' on Instance uuid 8168aa39-afce-4c9e-ba76-78a760767357 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:18:39 user nova-compute[70709]:   <uuid>8168aa39-afce-4c9e-ba76-78a760767357</uuid>
Jul 28 00:18:39 user nova-compute[70709]:   <name>instance-0000000f</name>
Jul 28 00:18:39 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:18:39 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:18:39 user nova-compute[70709]:   <metadata>
Jul 28 00:18:39 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:18:39 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:18:39 user nova-compute[70709]:       <nova:name>tempest-VolumesAdminNegativeTest-server-112387795</nova:name>
Jul 28 00:18:39 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:18:39</nova:creationTime>
Jul 28 00:18:39 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:18:39 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:18:39 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:18:39 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:18:39 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:18:39 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:18:39 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:18:39 user nova-compute[70709]:       <nova:owner>
Jul 28 00:18:39 user nova-compute[70709]:         <nova:user uuid="e1ee7cb9ed044e10a022b23f51bcb588">tempest-VolumesAdminNegativeTest-945099691-project-member</nova:user>
Jul 28 00:18:39 user nova-compute[70709]:         <nova:project uuid="1181361da7694becb7e59b4b47eb0760">tempest-VolumesAdminNegativeTest-945099691</nova:project>
Jul 28 00:18:39 user nova-compute[70709]:       </nova:owner>
Jul 28 00:18:39 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:18:39 user nova-compute[70709]:       <nova:ports>
Jul 28 00:18:39 user nova-compute[70709]:         <nova:port uuid="b3a39ad7-b4fb-42f8-afc2-038ad99f2f47">
Jul 28 00:18:39 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 28 00:18:39 user nova-compute[70709]:         </nova:port>
Jul 28 00:18:39 user nova-compute[70709]:       </nova:ports>
Jul 28 00:18:39 user nova-compute[70709]:     </nova:instance>
Jul 28 00:18:39 user nova-compute[70709]:   </metadata>
Jul 28 00:18:39 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:18:39 user nova-compute[70709]:     <system>
Jul 28 00:18:39 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:18:39 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:18:39 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:18:39 user nova-compute[70709]:       <entry name="serial">8168aa39-afce-4c9e-ba76-78a760767357</entry>
Jul 28 00:18:39 user nova-compute[70709]:       <entry name="uuid">8168aa39-afce-4c9e-ba76-78a760767357</entry>
Jul 28 00:18:39 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:18:39 user nova-compute[70709]:     </system>
Jul 28 00:18:39 user nova-compute[70709]:   </sysinfo>
Jul 28 00:18:39 user nova-compute[70709]:   <os>
Jul 28 00:18:39 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:18:39 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:18:39 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:18:39 user nova-compute[70709]:   </os>
Jul 28 00:18:39 user nova-compute[70709]:   <features>
Jul 28 00:18:39 user nova-compute[70709]:     <acpi/>
Jul 28 00:18:39 user nova-compute[70709]:     <apic/>
Jul 28 00:18:39 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:18:39 user nova-compute[70709]:   </features>
Jul 28 00:18:39 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:18:39 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:18:39 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:18:39 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:18:39 user nova-compute[70709]:   </clock>
Jul 28 00:18:39 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:18:39 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:18:39 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:18:39 user nova-compute[70709]:   </cpu>
Jul 28 00:18:39 user nova-compute[70709]:   <devices>
Jul 28 00:18:39 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:18:39 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:18:39 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk"/>
Jul 28 00:18:39 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:18:39 user nova-compute[70709]:     </disk>
Jul 28 00:18:39 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:18:39 user nova-compute[70709]:       <mac address="fa:16:3e:41:8c:f9"/>
Jul 28 00:18:39 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:18:39 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:18:39 user nova-compute[70709]:       <target dev="tapb3a39ad7-b4"/>
Jul 28 00:18:39 user nova-compute[70709]:     </interface>
Jul 28 00:18:39 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:18:39 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/console.log" append="off"/>
Jul 28 00:18:39 user nova-compute[70709]:     </serial>
Jul 28 00:18:39 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:18:39 user nova-compute[70709]:     <video>
Jul 28 00:18:39 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:18:39 user nova-compute[70709]:     </video>
Jul 28 00:18:39 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:18:39 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:18:39 user nova-compute[70709]:     </rng>
Jul 28 00:18:39 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:18:39 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:18:39 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:18:39 user nova-compute[70709]:     </memballoon>
Jul 28 00:18:39 user nova-compute[70709]:   </devices>
Jul 28 00:18:39 user nova-compute[70709]: </domain>
Jul 28 00:18:39 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-112387795',display_name='tempest-VolumesAdminNegativeTest-server-112387795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-112387795',id=15,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvxeCpoXyL4L/QGhEY0hwn6ca64Hgg+xkpCkOoFCbEILR2mSCAw20ll9UF+zLLNy3TqdK4RBtK9fzupjseRBhV7tRR33zFBMFP0a22zV0z999om01KaPV7ZDDB7fpLnKg==',key_name='tempest-keypair-263863682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1181361da7694becb7e59b4b47eb0760',ramdisk_id='',reservation_id='r-im8d98vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-945099691',owner_user_name='tempest-VolumesAdminNegativeTest-945099691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1ee7cb9ed044e10a022b23f51bcb588',uuid=8168aa39-afce-4c9e-ba76-78a760767357,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "address": "fa:16:3e:41:8c:f9", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a39ad7-b4", "ovs_interfaceid": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converting VIF {"id": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "address": "fa:16:3e:41:8c:f9", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a39ad7-b4", "ovs_interfaceid": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:8c:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3a39ad7-b4fb-42f8-afc2-038ad99f2f47,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a39ad7-b4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_vif [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:8c:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3a39ad7-b4fb-42f8-afc2-038ad99f2f47,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a39ad7-b4') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3a39ad7-b4, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3a39ad7-b4, col_values=(('external_ids', {'iface-id': 'b3a39ad7-b4fb-42f8-afc2-038ad99f2f47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:8c:f9', 'vm-uuid': '8168aa39-afce-4c9e-ba76-78a760767357'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:39 user nova-compute[70709]: INFO os_vif [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:8c:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3a39ad7-b4fb-42f8-afc2-038ad99f2f47,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a39ad7-b4')
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.utils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0415b96-cad0-44a3-80f9-f85c36e4882e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f52d96-c0a0-4b90-8ecd-0ee95527b6d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cd0fc5-3e03-4764-8097-172fb20ccb98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcefc7d9-78da-467a-8fc6-d4f979b1ed69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] No VIF found with MAC fa:16:3e:41:8c:f9, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:18:39 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:18:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d43ede7-cba6-400d-981e-5dc0c5369f20]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG os_brick.utils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:39 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updating existing volume attachment record: f2028621-96a8-4753-8b52-146d8785306e {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:18:40 user nova-compute[70709]: DEBUG nova.network.neutron [req-3cfa4919-53ab-4722-a99e-46e88b5282d3 req-ce496e41-7e82-4365-9d04-9d469ae46457 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Updated VIF entry in instance network info cache for port b3a39ad7-b4fb-42f8-afc2-038ad99f2f47. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:18:40 user nova-compute[70709]: DEBUG nova.network.neutron [req-3cfa4919-53ab-4722-a99e-46e88b5282d3 req-ce496e41-7e82-4365-9d04-9d469ae46457 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Updating instance_info_cache with network_info: [{"id": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "address": "fa:16:3e:41:8c:f9", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a39ad7-b4", "ovs_interfaceid": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:18:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3cfa4919-53ab-4722-a99e-46e88b5282d3 req-ce496e41-7e82-4365-9d04-9d469ae46457 service nova] Releasing lock "refresh_cache-8168aa39-afce-4c9e-ba76-78a760767357" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:18:40 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503505.6482317, 169813c4-7d36-4660-b2fa-4a27fe3e8c86 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:40 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] VM Stopped (Lifecycle Event)
Jul 28 00:18:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ccc8bf0b-b8f0-4b54-82d2-b56191ae61ac None None] [instance: 169813c4-7d36-4660-b2fa-4a27fe3e8c86] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-1a538141-3d40-4080-b7a4-ce8497c806d1 req-fcfafbbd-6fa0-4918-985f-0419f7b01bba service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1a538141-3d40-4080-b7a4-ce8497c806d1 req-fcfafbbd-6fa0-4918-985f-0419f7b01bba service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1a538141-3d40-4080-b7a4-ce8497c806d1 req-fcfafbbd-6fa0-4918-985f-0419f7b01bba service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1a538141-3d40-4080-b7a4-ce8497c806d1 req-fcfafbbd-6fa0-4918-985f-0419f7b01bba service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-1a538141-3d40-4080-b7a4-ce8497c806d1 req-fcfafbbd-6fa0-4918-985f-0419f7b01bba service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:41 user nova-compute[70709]: WARNING nova.compute.manager [req-1a538141-3d40-4080-b7a4-ce8497c806d1 req-fcfafbbd-6fa0-4918-985f-0419f7b01bba service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received unexpected event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with vm_state active and task_state rescuing.
Jul 28 00:18:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-08716c35-80cd-4f66-bc1b-289492ab259e req-d77f82f4-e53d-4518-9148-d42e4aa94a78 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Received event network-vif-plugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-08716c35-80cd-4f66-bc1b-289492ab259e req-d77f82f4-e53d-4518-9148-d42e4aa94a78 service nova] Acquiring lock "8168aa39-afce-4c9e-ba76-78a760767357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-08716c35-80cd-4f66-bc1b-289492ab259e req-d77f82f4-e53d-4518-9148-d42e4aa94a78 service nova] Lock "8168aa39-afce-4c9e-ba76-78a760767357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-08716c35-80cd-4f66-bc1b-289492ab259e req-d77f82f4-e53d-4518-9148-d42e4aa94a78 service nova] Lock "8168aa39-afce-4c9e-ba76-78a760767357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-08716c35-80cd-4f66-bc1b-289492ab259e req-d77f82f4-e53d-4518-9148-d42e4aa94a78 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] No waiting events found dispatching network-vif-plugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:42 user nova-compute[70709]: WARNING nova.compute.manager [req-08716c35-80cd-4f66-bc1b-289492ab259e req-d77f82f4-e53d-4518-9148-d42e4aa94a78 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Received unexpected event network-vif-plugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 for instance with vm_state building and task_state spawning.
Jul 28 00:18:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-7b3ec3ee-118f-4110-8491-5ca8e1ceb636 req-5d6e227e-3d31-4561-8732-2ed234a2b08b service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7b3ec3ee-118f-4110-8491-5ca8e1ceb636 req-5d6e227e-3d31-4561-8732-2ed234a2b08b service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7b3ec3ee-118f-4110-8491-5ca8e1ceb636 req-5d6e227e-3d31-4561-8732-2ed234a2b08b service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7b3ec3ee-118f-4110-8491-5ca8e1ceb636 req-5d6e227e-3d31-4561-8732-2ed234a2b08b service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-7b3ec3ee-118f-4110-8491-5ca8e1ceb636 req-5d6e227e-3d31-4561-8732-2ed234a2b08b service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:43 user nova-compute[70709]: WARNING nova.compute.manager [req-7b3ec3ee-118f-4110-8491-5ca8e1ceb636 req-5d6e227e-3d31-4561-8732-2ed234a2b08b service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received unexpected event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with vm_state active and task_state rescuing.
Jul 28 00:18:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:44 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503524.9043968, 8168aa39-afce-4c9e-ba76-78a760767357 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:44 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] VM Resumed (Lifecycle Event)
Jul 28 00:18:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:18:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:18:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-1d01765c-66f4-4a52-8fe3-d5939e471e2a tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:44 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Instance spawned successfully.
Jul 28 00:18:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:18:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:18:44 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503509.986803, 3139de03-95b1-4e8a-a15a-886dbd9cfb56 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:44 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] VM Stopped (Lifecycle Event)
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503524.910417, 8168aa39-afce-4c9e-ba76-78a760767357 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] VM Started (Lifecycle Event)
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b0ea3ebf-08e6-4a8a-8c96-f8436c88ca70 None None] [instance: 3139de03-95b1-4e8a-a15a-886dbd9cfb56] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-366e9d86-c1e2-4e0a-af10-8f1467b9ecb7 req-a0b5a18b-166a-4338-90b3-dcfd9d52d11e service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Received event network-vif-plugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-366e9d86-c1e2-4e0a-af10-8f1467b9ecb7 req-a0b5a18b-166a-4338-90b3-dcfd9d52d11e service nova] Acquiring lock "8168aa39-afce-4c9e-ba76-78a760767357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-366e9d86-c1e2-4e0a-af10-8f1467b9ecb7 req-a0b5a18b-166a-4338-90b3-dcfd9d52d11e service nova] Lock "8168aa39-afce-4c9e-ba76-78a760767357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-366e9d86-c1e2-4e0a-af10-8f1467b9ecb7 req-a0b5a18b-166a-4338-90b3-dcfd9d52d11e service nova] Lock "8168aa39-afce-4c9e-ba76-78a760767357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-366e9d86-c1e2-4e0a-af10-8f1467b9ecb7 req-a0b5a18b-166a-4338-90b3-dcfd9d52d11e service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] No waiting events found dispatching network-vif-plugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:45 user nova-compute[70709]: WARNING nova.compute.manager [req-366e9d86-c1e2-4e0a-af10-8f1467b9ecb7 req-a0b5a18b-166a-4338-90b3-dcfd9d52d11e service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Received unexpected event network-vif-plugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 for instance with vm_state building and task_state spawning.
Jul 28 00:18:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for a585b419-b9f5-4bd6-bbc9-cdfc4e732712 due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503524.9468737, a585b419-b9f5-4bd6-bbc9-cdfc4e732712 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] VM Resumed (Lifecycle Event)
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503524.9469836, a585b419-b9f5-4bd6-bbc9-cdfc4e732712 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] VM Started (Lifecycle Event)
Jul 28 00:18:45 user nova-compute[70709]: INFO nova.compute.manager [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Took 8.07 seconds to spawn the instance on the hypervisor.
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:18:45 user nova-compute[70709]: INFO nova.compute.manager [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Took 11.03 seconds to build instance.
Jul 28 00:18:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-02e10184-b6fc-4b78-8b55-1549be38bdb4 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.210s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:46 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503511.2078092, df55bbd3-31ab-42f8-9a71-4ed8e3c4428c => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:46 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] VM Stopped (Lifecycle Event)
Jul 28 00:18:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5d6ff049-6afd-48b9-aafa-052b71d63af6 None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5d6ff049-6afd-48b9-aafa-052b71d63af6 None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:18:46 user nova-compute[70709]: INFO nova.compute.manager [None req-5d6ff049-6afd-48b9-aafa-052b71d63af6 None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 28 00:18:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:18:50 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Creating image(s)
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "/opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "/opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "/opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.173s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.193s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk 1073741824" returned: 0 in 0.073s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.214s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:18:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Cannot resize image /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Ensure instance console log exists: /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Start _get_guest_xml network_info=[{"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'f2028621-96a8-4753-8b52-146d8785306e', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljdBCQOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b61aaab4-ca86-41e6-a576-a7174d89a284', 'attached_at': '', 'detached_at': '', 'volume_id': '1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 'serial': '1d66a522-ca12-42a5-9cf4-e81ca64c1cd0'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:18:51 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 28 00:18:51 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'vcpu_model' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljdBCQOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:51 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:51 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:51 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3574322e-9e5f-4c02-96c2-62e0a1a7ad4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:18:51 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aab1cf6-8410-4a91-9458-a6cb10b7a4b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0] added
Jul 28 00:18:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7f8979-c0a7-4d69-b85c-2909e2202e0d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9783066d-81f2-44a8-9eb0-47e705759032]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljdBCQOJ {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljdBCQOJ" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dba303-255f-4757-b91e-4c70e3eaaf84]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ljdBCQOJ'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503515.7670133, b61aaab4-ca86-41e6-a576-a7174d89a284 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:51 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] VM Stopped (Lifecycle Event)
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dac3713-0525-42c7-8ff2-cdea87ca7660]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8e2fc206-593a-4600-ac62-096b4158d52a None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78deace-8d69-419b-b63a-ffa292b13f10]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2be077c-18e2-41c6-bf9c-b568d8814301]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260]
Jul 28 00:18:51 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260] successful.
Jul 28 00:18:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[09211b41-540a-4f63-a11a-4681b77a4c7e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25f23e8-82b0-4f40-9f55-db60f660f569]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.032s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a037d7b-91c3-48da-9760-95342615ee8a]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljdBCQOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:18:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '23730353831366666', 'path': '/dev/sdc'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730353831366666', 'path': '/dev/sdc'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T00:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1529008866',display_name='tempest-ServerActionsTestOtherA-server-1351361021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1529008866',id=2,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-ekq6qgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b61aaab4-ca86-41e6-a576-a7174d89a284,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:18:52 user nova-compute[70709]:   <uuid>b61aaab4-ca86-41e6-a576-a7174d89a284</uuid>
Jul 28 00:18:52 user nova-compute[70709]:   <name>instance-00000002</name>
Jul 28 00:18:52 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:18:52 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:18:52 user nova-compute[70709]:   <metadata>
Jul 28 00:18:52 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:18:52 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:18:52 user nova-compute[70709]:       <nova:name>tempest-ServerActionsTestOtherA-server-1351361021</nova:name>
Jul 28 00:18:52 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:18:51</nova:creationTime>
Jul 28 00:18:52 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:18:52 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:18:52 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:18:52 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:18:52 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:18:52 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:18:52 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:18:52 user nova-compute[70709]:       <nova:owner>
Jul 28 00:18:52 user nova-compute[70709]:         <nova:user uuid="384ba52cf0bd4f03ac0dfc73cc81b31d">tempest-ServerActionsTestOtherA-448184614-project-member</nova:user>
Jul 28 00:18:52 user nova-compute[70709]:         <nova:project uuid="92ce75e559c74038919f88f186e35a17">tempest-ServerActionsTestOtherA-448184614</nova:project>
Jul 28 00:18:52 user nova-compute[70709]:       </nova:owner>
Jul 28 00:18:52 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:18:52 user nova-compute[70709]:       <nova:ports>
Jul 28 00:18:52 user nova-compute[70709]:         <nova:port uuid="ee9a657a-7c7d-4849-8394-9438487032f9">
Jul 28 00:18:52 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 28 00:18:52 user nova-compute[70709]:         </nova:port>
Jul 28 00:18:52 user nova-compute[70709]:       </nova:ports>
Jul 28 00:18:52 user nova-compute[70709]:     </nova:instance>
Jul 28 00:18:52 user nova-compute[70709]:   </metadata>
Jul 28 00:18:52 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:18:52 user nova-compute[70709]:     <system>
Jul 28 00:18:52 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:18:52 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:18:52 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:18:52 user nova-compute[70709]:       <entry name="serial">b61aaab4-ca86-41e6-a576-a7174d89a284</entry>
Jul 28 00:18:52 user nova-compute[70709]:       <entry name="uuid">b61aaab4-ca86-41e6-a576-a7174d89a284</entry>
Jul 28 00:18:52 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:18:52 user nova-compute[70709]:     </system>
Jul 28 00:18:52 user nova-compute[70709]:   </sysinfo>
Jul 28 00:18:52 user nova-compute[70709]:   <os>
Jul 28 00:18:52 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:18:52 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:18:52 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:18:52 user nova-compute[70709]:   </os>
Jul 28 00:18:52 user nova-compute[70709]:   <features>
Jul 28 00:18:52 user nova-compute[70709]:     <acpi/>
Jul 28 00:18:52 user nova-compute[70709]:     <apic/>
Jul 28 00:18:52 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:18:52 user nova-compute[70709]:   </features>
Jul 28 00:18:52 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:18:52 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:18:52 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:18:52 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:18:52 user nova-compute[70709]:   </clock>
Jul 28 00:18:52 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:18:52 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:18:52 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:18:52 user nova-compute[70709]:   </cpu>
Jul 28 00:18:52 user nova-compute[70709]:   <devices>
Jul 28 00:18:52 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:18:52 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:18:52 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk"/>
Jul 28 00:18:52 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:18:52 user nova-compute[70709]:     </disk>
Jul 28 00:18:52 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:18:52 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:18:52 user nova-compute[70709]:       <source dev="/dev/sdc"/>
Jul 28 00:18:52 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:18:52 user nova-compute[70709]:       <serial>1d66a522-ca12-42a5-9cf4-e81ca64c1cd0</serial>
Jul 28 00:18:52 user nova-compute[70709]:     </disk>
Jul 28 00:18:52 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:18:52 user nova-compute[70709]:       <mac address="fa:16:3e:4a:f3:cb"/>
Jul 28 00:18:52 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:18:52 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:18:52 user nova-compute[70709]:       <target dev="tapee9a657a-7c"/>
Jul 28 00:18:52 user nova-compute[70709]:     </interface>
Jul 28 00:18:52 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:18:52 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/console.log" append="off"/>
Jul 28 00:18:52 user nova-compute[70709]:     </serial>
Jul 28 00:18:52 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:18:52 user nova-compute[70709]:     <video>
Jul 28 00:18:52 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:18:52 user nova-compute[70709]:     </video>
Jul 28 00:18:52 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:18:52 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:18:52 user nova-compute[70709]:     </rng>
Jul 28 00:18:52 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:18:52 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:18:52 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:18:52 user nova-compute[70709]:     </memballoon>
Jul 28 00:18:52 user nova-compute[70709]:   </devices>
Jul 28 00:18:52 user nova-compute[70709]: </domain>
Jul 28 00:18:52 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T00:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1529008866',display_name='tempest-ServerActionsTestOtherA-server-1351361021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1529008866',id=2,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-ekq6qgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b61aaab4-ca86-41e6-a576-a7174d89a284,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG os_vif [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee9a657a-7c, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee9a657a-7c, col_values=(('external_ids', {'iface-id': 'ee9a657a-7c7d-4849-8394-9438487032f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:f3:cb', 'vm-uuid': 'b61aaab4-ca86-41e6-a576-a7174d89a284'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:52 user nova-compute[70709]: INFO os_vif [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c')
Jul 28 00:18:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No VIF found with MAC fa:16:3e:4a:f3:cb, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:18:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-5c1b37f4-a0c1-4f7b-9017-bc24794d186e req-ef8c35b3-d9b3-4f0e-810e-b27c84d35063 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5c1b37f4-a0c1-4f7b-9017-bc24794d186e req-ef8c35b3-d9b3-4f0e-810e-b27c84d35063 service nova] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5c1b37f4-a0c1-4f7b-9017-bc24794d186e req-ef8c35b3-d9b3-4f0e-810e-b27c84d35063 service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5c1b37f4-a0c1-4f7b-9017-bc24794d186e req-ef8c35b3-d9b3-4f0e-810e-b27c84d35063 service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-5c1b37f4-a0c1-4f7b-9017-bc24794d186e req-ef8c35b3-d9b3-4f0e-810e-b27c84d35063 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] No waiting events found dispatching network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:54 user nova-compute[70709]: WARNING nova.compute.manager [req-5c1b37f4-a0c1-4f7b-9017-bc24794d186e req-ef8c35b3-d9b3-4f0e-810e-b27c84d35063 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received unexpected event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 for instance with vm_state active and task_state rebuild_spawning.
Jul 28 00:18:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Starting finish_migration {{(pid=70709) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance directory exists: not creating {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 28 00:18:55 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Creating image(s)
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.objects.instance [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'trusted_certs' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.216s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk. size=21474836480 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk 21474836480 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk 21474836480" returned: 0 in 0.069s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Ensure instance console log exists: /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Start _get_guest_xml network_info=[{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1008293406-network", "vif_mac": "fa:16:3e:58:0f:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '873a7e29-c7f4-4cb8-b1b6-b7e15ff493a9', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaVgHnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'df55bbd3-31ab-42f8-9a71-4ed8e3c4428c', 'attached_at': '2023-07-28T00:18:55.000000', 'detached_at': '', 'volume_id': '86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'serial': '86b782c7-df0d-4e2a-8b05-6dba869dde7c'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:18:55 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:18:55 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.objects.instance [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'vcpu_model' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaVgHnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:18:55 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:55 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:18:55 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[054d42f5-e7ac-49c4-ad18-695b286e063e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:18:55 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bb7858-de28-4d43-b89b-f5eda9b5090b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c] added
Jul 28 00:18:55 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf51bcb2-f390-493d-8db9-cba072572e97]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ac2d52-1799-4e6b-a8f5-a84a6d744a92]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERaVgHnU {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERaVgHnU" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[873ebc6d-3922-4a9e-807a-498ccc75cce9]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ERaVgHnU'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f2d06e-5dd1-48b0-862e-3956e59d3218]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[738b00d8-da0f-4b21-9f5a-568006ca2bc8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:55 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:55 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:55 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:55 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:55 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d77c12b-b50c-4ee2-b724-c13733dd0797]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]
Jul 28 00:18:56 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.
Jul 28 00:18:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efe0f28-ac35-45a3-93f2-c554d158a66f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[77062e4f-278c-4325-9b4e-a0b95a6bd5cf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:18:56 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:18:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cad0251-c784-44fe-8e12-a773b10684bb]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaVgHnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-d0709f50-cf6f-45a7-8f0e-a290d8074ee4 req-280cba66-23ba-4175-948b-5a21acd5fb34 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d0709f50-cf6f-45a7-8f0e-a290d8074ee4 req-280cba66-23ba-4175-948b-5a21acd5fb34 service nova] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d0709f50-cf6f-45a7-8f0e-a290d8074ee4 req-280cba66-23ba-4175-948b-5a21acd5fb34 service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d0709f50-cf6f-45a7-8f0e-a290d8074ee4 req-280cba66-23ba-4175-948b-5a21acd5fb34 service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-d0709f50-cf6f-45a7-8f0e-a290d8074ee4 req-280cba66-23ba-4175-948b-5a21acd5fb34 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] No waiting events found dispatching network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:56 user nova-compute[70709]: WARNING nova.compute.manager [req-d0709f50-cf6f-45a7-8f0e-a290d8074ee4 req-280cba66-23ba-4175-948b-5a21acd5fb34 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received unexpected event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 for instance with vm_state active and task_state rebuild_spawning.
Jul 28 00:18:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503536.764854, b61aaab4-ca86-41e6-a576-a7174d89a284 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:56 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] VM Resumed (Lifecycle Event)
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:18:56 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Instance spawned successfully.
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:18:56 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503536.7686472, b61aaab4-ca86-41e6-a576-a7174d89a284 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:18:56 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] VM Started (Lifecycle Event)
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:18:56 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 28 00:18:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70709) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b6f3be97-c2e8-41eb-b1a1-544dd299a497 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.100s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26461323732373632', 'path': '/dev/sdg'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461323732373632', 'path': '/dev/sdg'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1488928010',display_name='tempest-ServerActionsTestOtherB-server-1488928010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1488928010',id=3,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnNPKIDRaM81k628x28KRrACS+k9io0IYMr8rKnbfV6R9PEGedJ0uPueig7JixSq/MVd5cruSs8PGo9MLWndddj6j9yk5HzD1hsNyADvhHRJFhgOMMfk3L2UUGGtvzDbA==',key_name='tempest-keypair-458737518',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8a7ed8f269b4e989727baa24619d774',ramdisk_id='',reservation_id='r-0vm06iql',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900188209',owner_user_name='tempest-ServerActionsTestOtherB-1900188209-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc9412c0c5a345399b7cc2ff4540535d',uuid=df55bbd3-31ab-42f8-9a71-4ed8e3c4428c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1008293406-network", "vif_mac": "fa:16:3e:58:0f:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converting VIF {"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1008293406-network", "vif_mac": "fa:16:3e:58:0f:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:18:57 user nova-compute[70709]:   <uuid>df55bbd3-31ab-42f8-9a71-4ed8e3c4428c</uuid>
Jul 28 00:18:57 user nova-compute[70709]:   <name>instance-00000003</name>
Jul 28 00:18:57 user nova-compute[70709]:   <memory>2097152</memory>
Jul 28 00:18:57 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:18:57 user nova-compute[70709]:   <metadata>
Jul 28 00:18:57 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:18:57 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:18:57 user nova-compute[70709]:       <nova:name>tempest-ServerActionsTestOtherB-server-1488928010</nova:name>
Jul 28 00:18:57 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:18:55</nova:creationTime>
Jul 28 00:18:57 user nova-compute[70709]:       <nova:flavor name="m1.small">
Jul 28 00:18:57 user nova-compute[70709]:         <nova:memory>2048</nova:memory>
Jul 28 00:18:57 user nova-compute[70709]:         <nova:disk>20</nova:disk>
Jul 28 00:18:57 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:18:57 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:18:57 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:18:57 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:18:57 user nova-compute[70709]:       <nova:owner>
Jul 28 00:18:57 user nova-compute[70709]:         <nova:user uuid="fc9412c0c5a345399b7cc2ff4540535d">tempest-ServerActionsTestOtherB-1900188209-project-member</nova:user>
Jul 28 00:18:57 user nova-compute[70709]:         <nova:project uuid="c8a7ed8f269b4e989727baa24619d774">tempest-ServerActionsTestOtherB-1900188209</nova:project>
Jul 28 00:18:57 user nova-compute[70709]:       </nova:owner>
Jul 28 00:18:57 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:18:57 user nova-compute[70709]:       <nova:ports>
Jul 28 00:18:57 user nova-compute[70709]:         <nova:port uuid="7e92340f-f93d-411f-8e69-2a75164b3679">
Jul 28 00:18:57 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 28 00:18:57 user nova-compute[70709]:         </nova:port>
Jul 28 00:18:57 user nova-compute[70709]:       </nova:ports>
Jul 28 00:18:57 user nova-compute[70709]:     </nova:instance>
Jul 28 00:18:57 user nova-compute[70709]:   </metadata>
Jul 28 00:18:57 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:18:57 user nova-compute[70709]:     <system>
Jul 28 00:18:57 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:18:57 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:18:57 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:18:57 user nova-compute[70709]:       <entry name="serial">df55bbd3-31ab-42f8-9a71-4ed8e3c4428c</entry>
Jul 28 00:18:57 user nova-compute[70709]:       <entry name="uuid">df55bbd3-31ab-42f8-9a71-4ed8e3c4428c</entry>
Jul 28 00:18:57 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:18:57 user nova-compute[70709]:     </system>
Jul 28 00:18:57 user nova-compute[70709]:   </sysinfo>
Jul 28 00:18:57 user nova-compute[70709]:   <os>
Jul 28 00:18:57 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:18:57 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:18:57 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:18:57 user nova-compute[70709]:   </os>
Jul 28 00:18:57 user nova-compute[70709]:   <features>
Jul 28 00:18:57 user nova-compute[70709]:     <acpi/>
Jul 28 00:18:57 user nova-compute[70709]:     <apic/>
Jul 28 00:18:57 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:18:57 user nova-compute[70709]:   </features>
Jul 28 00:18:57 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:18:57 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:18:57 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:18:57 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:18:57 user nova-compute[70709]:   </clock>
Jul 28 00:18:57 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:18:57 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:18:57 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:18:57 user nova-compute[70709]:   </cpu>
Jul 28 00:18:57 user nova-compute[70709]:   <devices>
Jul 28 00:18:57 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:18:57 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:18:57 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk"/>
Jul 28 00:18:57 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:18:57 user nova-compute[70709]:     </disk>
Jul 28 00:18:57 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:18:57 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:18:57 user nova-compute[70709]:       <source dev="/dev/sdg"/>
Jul 28 00:18:57 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:18:57 user nova-compute[70709]:       <serial>86b782c7-df0d-4e2a-8b05-6dba869dde7c</serial>
Jul 28 00:18:57 user nova-compute[70709]:     </disk>
Jul 28 00:18:57 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:18:57 user nova-compute[70709]:       <mac address="fa:16:3e:58:0f:bc"/>
Jul 28 00:18:57 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:18:57 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:18:57 user nova-compute[70709]:       <target dev="tap7e92340f-f9"/>
Jul 28 00:18:57 user nova-compute[70709]:     </interface>
Jul 28 00:18:57 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:18:57 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/console.log" append="off"/>
Jul 28 00:18:57 user nova-compute[70709]:     </serial>
Jul 28 00:18:57 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:18:57 user nova-compute[70709]:     <video>
Jul 28 00:18:57 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:18:57 user nova-compute[70709]:     </video>
Jul 28 00:18:57 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:18:57 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:18:57 user nova-compute[70709]:     </rng>
Jul 28 00:18:57 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:18:57 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:18:57 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:18:57 user nova-compute[70709]:     </memballoon>
Jul 28 00:18:57 user nova-compute[70709]:   </devices>
Jul 28 00:18:57 user nova-compute[70709]: </domain>
Jul 28 00:18:57 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1488928010',display_name='tempest-ServerActionsTestOtherB-server-1488928010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1488928010',id=3,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnNPKIDRaM81k628x28KRrACS+k9io0IYMr8rKnbfV6R9PEGedJ0uPueig7JixSq/MVd5cruSs8PGo9MLWndddj6j9yk5HzD1hsNyADvhHRJFhgOMMfk3L2UUGGtvzDbA==',key_name='tempest-keypair-458737518',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8a7ed8f269b4e989727baa24619d774',ramdisk_id='',reservation_id='r-0vm06iql',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900188209',owner_user_name='tempest-ServerActionsTestOtherB-1900188209-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc9412c0c5a345399b7cc2ff4540535d',uuid=df55bbd3-31ab-42f8-9a71-4ed8e3c4428c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1008293406-network", "vif_mac": "fa:16:3e:58:0f:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converting VIF {"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1008293406-network", "vif_mac": "fa:16:3e:58:0f:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG os_vif [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e92340f-f9, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e92340f-f9, col_values=(('external_ids', {'iface-id': '7e92340f-f93d-411f-8e69-2a75164b3679', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:0f:bc', 'vm-uuid': 'df55bbd3-31ab-42f8-9a71-4ed8e3c4428c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:57 user nova-compute[70709]: INFO os_vif [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9')
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:18:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] No VIF found with MAC fa:16:3e:58:0f:bc, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-dd4bc94e-92a3-4a7b-ba13-ac7af3c47a01 req-4eaea6c9-c75b-4e27-81d2-f141370988a6 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dd4bc94e-92a3-4a7b-ba13-ac7af3c47a01 req-4eaea6c9-c75b-4e27-81d2-f141370988a6 service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dd4bc94e-92a3-4a7b-ba13-ac7af3c47a01 req-4eaea6c9-c75b-4e27-81d2-f141370988a6 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dd4bc94e-92a3-4a7b-ba13-ac7af3c47a01 req-4eaea6c9-c75b-4e27-81d2-f141370988a6 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-dd4bc94e-92a3-4a7b-ba13-ac7af3c47a01 req-4eaea6c9-c75b-4e27-81d2-f141370988a6 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:18:59 user nova-compute[70709]: WARNING nova.compute.manager [req-dd4bc94e-92a3-4a7b-ba13-ac7af3c47a01 req-4eaea6c9-c75b-4e27-81d2-f141370988a6 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received unexpected event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with vm_state active and task_state resize_finish.
Jul 28 00:18:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:18:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:01 user nova-compute[70709]: DEBUG nova.compute.manager [req-850e6ed8-8163-4e63-b6e1-b2a86f8f18cf req-6d7d8840-896f-4567-a9f7-99b22c52efb0 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:19:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-850e6ed8-8163-4e63-b6e1-b2a86f8f18cf req-6d7d8840-896f-4567-a9f7-99b22c52efb0 service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-850e6ed8-8163-4e63-b6e1-b2a86f8f18cf req-6d7d8840-896f-4567-a9f7-99b22c52efb0 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-850e6ed8-8163-4e63-b6e1-b2a86f8f18cf req-6d7d8840-896f-4567-a9f7-99b22c52efb0 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:01 user nova-compute[70709]: DEBUG nova.compute.manager [req-850e6ed8-8163-4e63-b6e1-b2a86f8f18cf req-6d7d8840-896f-4567-a9f7-99b22c52efb0 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:19:01 user nova-compute[70709]: WARNING nova.compute.manager [req-850e6ed8-8163-4e63-b6e1-b2a86f8f18cf req-6d7d8840-896f-4567-a9f7-99b22c52efb0 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received unexpected event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with vm_state active and task_state resize_finish.
Jul 28 00:19:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:01 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503541.8094656, df55bbd3-31ab-42f8-9a71-4ed8e3c4428c => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:19:01 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] VM Resumed (Lifecycle Event)
Jul 28 00:19:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:19:01 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance running successfully.
Jul 28 00:19:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:19:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Failed to set time: agent not configured {{(pid=70709) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 28 00:19:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-4f78ba46-bdb3-4deb-904c-87f04b71f30c tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] finish_migration finished successfully. {{(pid=70709) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 28 00:19:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:19:01 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 28 00:19:01 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503541.8134897, df55bbd3-31ab-42f8-9a71-4ed8e3c4428c => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:19:01 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] VM Started (Lifecycle Event)
Jul 28 00:19:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:19:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:19:01 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 28 00:19:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:19:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "c6297718-d595-4657-aa32-aa75bffdf955" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:19:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:19:09 user nova-compute[70709]: INFO nova.compute.claims [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Claim successful on node user
Jul 28 00:19:09 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:19:09 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:19:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:19:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:19:09 user nova-compute[70709]: DEBUG nova.network.neutron [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:19:09 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:19:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:19:09 user nova-compute[70709]: DEBUG nova.policy [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b436a6349354f97a81ea3977aec28a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce0f27cc343a5ac86331ee21076ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:19:10 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Creating image(s)
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "/opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "/opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.198s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.226s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk 1073741824" returned: 0 in 0.072s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.184s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG nova.network.neutron [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Successfully created port: 726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Cannot resize image /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG nova.objects.instance [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lazy-loading 'migration_context' on Instance uuid c6297718-d595-4657-aa32-aa75bffdf955 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Ensure instance console log exists: /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG nova.network.neutron [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Successfully updated port: 726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "refresh_cache-c6297718-d595-4657-aa32-aa75bffdf955" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquired lock "refresh_cache-c6297718-d595-4657-aa32-aa75bffdf955" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG nova.network.neutron [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG nova.compute.manager [req-e6de7e59-49c2-4bab-a597-3041b77cc81c req-9223c148-90fe-49de-b008-5d96c99fd457 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-changed-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG nova.compute.manager [req-e6de7e59-49c2-4bab-a597-3041b77cc81c req-9223c148-90fe-49de-b008-5d96c99fd457 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Refreshing instance network info cache due to event network-changed-726f9120-5db5-4e03-aa01-07c310849ae4. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e6de7e59-49c2-4bab-a597-3041b77cc81c req-9223c148-90fe-49de-b008-5d96c99fd457 service nova] Acquiring lock "refresh_cache-c6297718-d595-4657-aa32-aa75bffdf955" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:19:11 user nova-compute[70709]: DEBUG nova.network.neutron [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.network.neutron [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Updating instance_info_cache with network_info: [{"id": "726f9120-5db5-4e03-aa01-07c310849ae4", "address": "fa:16:3e:85:c0:80", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f9120-5d", "ovs_interfaceid": "726f9120-5db5-4e03-aa01-07c310849ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Releasing lock "refresh_cache-c6297718-d595-4657-aa32-aa75bffdf955" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Instance network_info: |[{"id": "726f9120-5db5-4e03-aa01-07c310849ae4", "address": "fa:16:3e:85:c0:80", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f9120-5d", "ovs_interfaceid": "726f9120-5db5-4e03-aa01-07c310849ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e6de7e59-49c2-4bab-a597-3041b77cc81c req-9223c148-90fe-49de-b008-5d96c99fd457 service nova] Acquired lock "refresh_cache-c6297718-d595-4657-aa32-aa75bffdf955" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.network.neutron [req-e6de7e59-49c2-4bab-a597-3041b77cc81c req-9223c148-90fe-49de-b008-5d96c99fd457 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Refreshing network info cache for port 726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Start _get_guest_xml network_info=[{"id": "726f9120-5db5-4e03-aa01-07c310849ae4", "address": "fa:16:3e:85:c0:80", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f9120-5d", "ovs_interfaceid": "726f9120-5db5-4e03-aa01-07c310849ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:19:12 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:19:12 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1300495577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1300495577',id=16,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhz3b/+OTnnvXXqis9mWUuU2JeujnEQhRF8y6xBqEX+l661Wggc+ycz9K5OasbJCAPev99gjeXqePw3PUp7E6xsV1VpsbGc2qz8q5qhN08HuMfcuvAClChCXsU2M5EIjw==',key_name='tempest-keypair-1135389968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='526ce0f27cc343a5ac86331ee21076ec',ramdisk_id='',reservation_id='r-4q8nn484',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1273279077',owner_user_name='tempest-ServerActionsV293TestJSON-1273279077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b436a6349354f97a81ea3977aec28a5',uuid=c6297718-d595-4657-aa32-aa75bffdf955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "726f9120-5db5-4e03-aa01-07c310849ae4", "address": "fa:16:3e:85:c0:80", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f9120-5d", "ovs_interfaceid": "726f9120-5db5-4e03-aa01-07c310849ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converting VIF {"id": "726f9120-5db5-4e03-aa01-07c310849ae4", "address": "fa:16:3e:85:c0:80", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f9120-5d", "ovs_interfaceid": "726f9120-5db5-4e03-aa01-07c310849ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:c0:80,bridge_name='br-int',has_traffic_filtering=True,id=726f9120-5db5-4e03-aa01-07c310849ae4,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f9120-5d') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lazy-loading 'pci_devices' on Instance uuid c6297718-d595-4657-aa32-aa75bffdf955 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:19:12 user nova-compute[70709]:   <uuid>c6297718-d595-4657-aa32-aa75bffdf955</uuid>
Jul 28 00:19:12 user nova-compute[70709]:   <name>instance-00000010</name>
Jul 28 00:19:12 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:19:12 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:19:12 user nova-compute[70709]:   <metadata>
Jul 28 00:19:12 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:19:12 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:19:12 user nova-compute[70709]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1300495577</nova:name>
Jul 28 00:19:12 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:19:12</nova:creationTime>
Jul 28 00:19:12 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:19:12 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:19:12 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:19:12 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:19:12 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:19:12 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:19:12 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:19:12 user nova-compute[70709]:       <nova:owner>
Jul 28 00:19:12 user nova-compute[70709]:         <nova:user uuid="8b436a6349354f97a81ea3977aec28a5">tempest-ServerActionsV293TestJSON-1273279077-project-member</nova:user>
Jul 28 00:19:12 user nova-compute[70709]:         <nova:project uuid="526ce0f27cc343a5ac86331ee21076ec">tempest-ServerActionsV293TestJSON-1273279077</nova:project>
Jul 28 00:19:12 user nova-compute[70709]:       </nova:owner>
Jul 28 00:19:12 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:19:12 user nova-compute[70709]:       <nova:ports>
Jul 28 00:19:12 user nova-compute[70709]:         <nova:port uuid="726f9120-5db5-4e03-aa01-07c310849ae4">
Jul 28 00:19:12 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 28 00:19:12 user nova-compute[70709]:         </nova:port>
Jul 28 00:19:12 user nova-compute[70709]:       </nova:ports>
Jul 28 00:19:12 user nova-compute[70709]:     </nova:instance>
Jul 28 00:19:12 user nova-compute[70709]:   </metadata>
Jul 28 00:19:12 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:19:12 user nova-compute[70709]:     <system>
Jul 28 00:19:12 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:19:12 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:19:12 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:19:12 user nova-compute[70709]:       <entry name="serial">c6297718-d595-4657-aa32-aa75bffdf955</entry>
Jul 28 00:19:12 user nova-compute[70709]:       <entry name="uuid">c6297718-d595-4657-aa32-aa75bffdf955</entry>
Jul 28 00:19:12 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:19:12 user nova-compute[70709]:     </system>
Jul 28 00:19:12 user nova-compute[70709]:   </sysinfo>
Jul 28 00:19:12 user nova-compute[70709]:   <os>
Jul 28 00:19:12 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:19:12 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:19:12 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:19:12 user nova-compute[70709]:   </os>
Jul 28 00:19:12 user nova-compute[70709]:   <features>
Jul 28 00:19:12 user nova-compute[70709]:     <acpi/>
Jul 28 00:19:12 user nova-compute[70709]:     <apic/>
Jul 28 00:19:12 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:19:12 user nova-compute[70709]:   </features>
Jul 28 00:19:12 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:19:12 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:19:12 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:19:12 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:19:12 user nova-compute[70709]:   </clock>
Jul 28 00:19:12 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:19:12 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:19:12 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:19:12 user nova-compute[70709]:   </cpu>
Jul 28 00:19:12 user nova-compute[70709]:   <devices>
Jul 28 00:19:12 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:19:12 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:19:12 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk"/>
Jul 28 00:19:12 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:19:12 user nova-compute[70709]:     </disk>
Jul 28 00:19:12 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:19:12 user nova-compute[70709]:       <mac address="fa:16:3e:85:c0:80"/>
Jul 28 00:19:12 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:19:12 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:19:12 user nova-compute[70709]:       <target dev="tap726f9120-5d"/>
Jul 28 00:19:12 user nova-compute[70709]:     </interface>
Jul 28 00:19:12 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:19:12 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/console.log" append="off"/>
Jul 28 00:19:12 user nova-compute[70709]:     </serial>
Jul 28 00:19:12 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:19:12 user nova-compute[70709]:     <video>
Jul 28 00:19:12 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:19:12 user nova-compute[70709]:     </video>
Jul 28 00:19:12 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:19:12 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:19:12 user nova-compute[70709]:     </rng>
Jul 28 00:19:12 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:19:12 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:19:12 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:19:12 user nova-compute[70709]:     </memballoon>
Jul 28 00:19:12 user nova-compute[70709]:   </devices>
Jul 28 00:19:12 user nova-compute[70709]: </domain>
Jul 28 00:19:12 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1300495577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1300495577',id=16,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhz3b/+OTnnvXXqis9mWUuU2JeujnEQhRF8y6xBqEX+l661Wggc+ycz9K5OasbJCAPev99gjeXqePw3PUp7E6xsV1VpsbGc2qz8q5qhN08HuMfcuvAClChCXsU2M5EIjw==',key_name='tempest-keypair-1135389968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='526ce0f27cc343a5ac86331ee21076ec',ramdisk_id='',reservation_id='r-4q8nn484',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1273279077',owner_user_name='tempest-ServerActionsV293TestJSON-1273279077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b436a6349354f97a81ea3977aec28a5',uuid=c6297718-d595-4657-aa32-aa75bffdf955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "726f9120-5db5-4e03-aa01-07c310849ae4", "address": "fa:16:3e:85:c0:80", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f9120-5d", "ovs_interfaceid": "726f9120-5db5-4e03-aa01-07c310849ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converting VIF {"id": "726f9120-5db5-4e03-aa01-07c310849ae4", "address": "fa:16:3e:85:c0:80", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f9120-5d", "ovs_interfaceid": "726f9120-5db5-4e03-aa01-07c310849ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:c0:80,bridge_name='br-int',has_traffic_filtering=True,id=726f9120-5db5-4e03-aa01-07c310849ae4,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f9120-5d') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG os_vif [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:c0:80,bridge_name='br-int',has_traffic_filtering=True,id=726f9120-5db5-4e03-aa01-07c310849ae4,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f9120-5d') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap726f9120-5d, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap726f9120-5d, col_values=(('external_ids', {'iface-id': '726f9120-5db5-4e03-aa01-07c310849ae4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:c0:80', 'vm-uuid': 'c6297718-d595-4657-aa32-aa75bffdf955'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:12 user nova-compute[70709]: INFO os_vif [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:c0:80,bridge_name='br-int',has_traffic_filtering=True,id=726f9120-5db5-4e03-aa01-07c310849ae4,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f9120-5d')
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] No VIF found with MAC fa:16:3e:85:c0:80, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.network.neutron [req-e6de7e59-49c2-4bab-a597-3041b77cc81c req-9223c148-90fe-49de-b008-5d96c99fd457 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Updated VIF entry in instance network info cache for port 726f9120-5db5-4e03-aa01-07c310849ae4. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.network.neutron [req-e6de7e59-49c2-4bab-a597-3041b77cc81c req-9223c148-90fe-49de-b008-5d96c99fd457 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Updating instance_info_cache with network_info: [{"id": "726f9120-5db5-4e03-aa01-07c310849ae4", "address": "fa:16:3e:85:c0:80", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f9120-5d", "ovs_interfaceid": "726f9120-5db5-4e03-aa01-07c310849ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e6de7e59-49c2-4bab-a597-3041b77cc81c req-9223c148-90fe-49de-b008-5d96c99fd457 service nova] Releasing lock "refresh_cache-c6297718-d595-4657-aa32-aa75bffdf955" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:12 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:19:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-be761fc2-cff8-4569-8b41-412361374926 req-1e230efc-ab86-43a5-b1de-3e37e7f4ad56 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be761fc2-cff8-4569-8b41-412361374926 req-1e230efc-ab86-43a5-b1de-3e37e7f4ad56 service nova] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be761fc2-cff8-4569-8b41-412361374926 req-1e230efc-ab86-43a5-b1de-3e37e7f4ad56 service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be761fc2-cff8-4569-8b41-412361374926 req-1e230efc-ab86-43a5-b1de-3e37e7f4ad56 service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-be761fc2-cff8-4569-8b41-412361374926 req-1e230efc-ab86-43a5-b1de-3e37e7f4ad56 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] No waiting events found dispatching network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:19:14 user nova-compute[70709]: WARNING nova.compute.manager [req-be761fc2-cff8-4569-8b41-412361374926 req-1e230efc-ab86-43a5-b1de-3e37e7f4ad56 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received unexpected event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 for instance with vm_state building and task_state spawning.
Jul 28 00:19:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-e890728a-5887-4f06-a3bb-f1f263c54c40 req-a60fba20-d02c-40e3-9f00-4d5d3c5c13ab service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e890728a-5887-4f06-a3bb-f1f263c54c40 req-a60fba20-d02c-40e3-9f00-4d5d3c5c13ab service nova] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e890728a-5887-4f06-a3bb-f1f263c54c40 req-a60fba20-d02c-40e3-9f00-4d5d3c5c13ab service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e890728a-5887-4f06-a3bb-f1f263c54c40 req-a60fba20-d02c-40e3-9f00-4d5d3c5c13ab service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-e890728a-5887-4f06-a3bb-f1f263c54c40 req-a60fba20-d02c-40e3-9f00-4d5d3c5c13ab service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] No waiting events found dispatching network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:19:16 user nova-compute[70709]: WARNING nova.compute.manager [req-e890728a-5887-4f06-a3bb-f1f263c54c40 req-a60fba20-d02c-40e3-9f00-4d5d3c5c13ab service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received unexpected event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 for instance with vm_state building and task_state spawning.
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503556.5083952, c6297718-d595-4657-aa32-aa75bffdf955 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:19:16 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: c6297718-d595-4657-aa32-aa75bffdf955] VM Resumed (Lifecycle Event)
Jul 28 00:19:16 user nova-compute[70709]: INFO nova.compute.manager [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Rescuing
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquired lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:19:16 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Instance spawned successfully.
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:16 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: c6297718-d595-4657-aa32-aa75bffdf955] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503556.5189295, c6297718-d595-4657-aa32-aa75bffdf955 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:19:16 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: c6297718-d595-4657-aa32-aa75bffdf955] VM Started (Lifecycle Event)
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:16 user nova-compute[70709]: INFO nova.compute.manager [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Took 6.68 seconds to spawn the instance on the hypervisor.
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:16 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: c6297718-d595-4657-aa32-aa75bffdf955] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:16 user nova-compute[70709]: INFO nova.compute.manager [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Took 7.74 seconds to build instance.
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-87135a7f-2573-46fd-8602-f048c9f4d565 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "c6297718-d595-4657-aa32-aa75bffdf955" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.911s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:19:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Updating instance_info_cache with network_info: [{"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Releasing lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-53b0261d-6039-4526-874c-289de1173b86 req-4b74536e-42e8-47c0-bb10-eddad9b57580 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-unplugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-53b0261d-6039-4526-874c-289de1173b86 req-4b74536e-42e8-47c0-bb10-eddad9b57580 service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-53b0261d-6039-4526-874c-289de1173b86 req-4b74536e-42e8-47c0-bb10-eddad9b57580 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-53b0261d-6039-4526-874c-289de1173b86 req-4b74536e-42e8-47c0-bb10-eddad9b57580 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-53b0261d-6039-4526-874c-289de1173b86 req-4b74536e-42e8-47c0-bb10-eddad9b57580 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-unplugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:19:17 user nova-compute[70709]: WARNING nova.compute.manager [req-53b0261d-6039-4526-874c-289de1173b86 req-4b74536e-42e8-47c0-bb10-eddad9b57580 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received unexpected event network-vif-unplugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with vm_state active and task_state rescuing.
Jul 28 00:19:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:19:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Instance destroyed successfully.
Jul 28 00:19:18 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:19:18 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:19:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7411MB free_disk=25.429061889648438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:19:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Attempting a stable device rescue
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70709) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Instance directory exists: not creating {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 28 00:19:19 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Creating image(s)
Jul 28 00:19:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "/opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "/opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "/opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'trusted_certs' on Instance uuid 159a0ce2-f6b6-45bf-a743-74da642a79fe {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "9acaf5ccf3411b61d5765e9e596faddf3c91dcee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "9acaf5ccf3411b61d5765e9e596faddf3c91dcee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Applying migration context for instance df55bbd3-31ab-42f8-9a71-4ed8e3c4428c as it has an incoming, in-progress migration fd6c45dd-89c9-4228-b535-c46894436656. Migration status is finished {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 28 00:19:19 user nova-compute[70709]: INFO nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating resource usage from migration fd6c45dd-89c9-4228-b535-c46894436656
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Migration fd6c45dd-89c9-4228-b535-c46894436656 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance df55bbd3-31ab-42f8-9a71-4ed8e3c4428c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 8168aa39-afce-4c9e-ba76-78a760767357 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance c6297718-d595-4657-aa32-aa75bffdf955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:19:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee.part --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-37052383-04a5-4e31-a1cd-86d01cdf48fe req-efbb4866-4497-49ba-bf7f-0ebc04b45c8d service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-37052383-04a5-4e31-a1cd-86d01cdf48fe req-efbb4866-4497-49ba-bf7f-0ebc04b45c8d service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-37052383-04a5-4e31-a1cd-86d01cdf48fe req-efbb4866-4497-49ba-bf7f-0ebc04b45c8d service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-37052383-04a5-4e31-a1cd-86d01cdf48fe req-efbb4866-4497-49ba-bf7f-0ebc04b45c8d service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-37052383-04a5-4e31-a1cd-86d01cdf48fe req-efbb4866-4497-49ba-bf7f-0ebc04b45c8d service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:19:20 user nova-compute[70709]: WARNING nova.compute.manager [req-37052383-04a5-4e31-a1cd-86d01cdf48fe req-efbb4866-4497-49ba-bf7f-0ebc04b45c8d service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received unexpected event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with vm_state active and task_state rescuing.
Jul 28 00:19:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee.part --force-share --output=json" returned: 0 in 0.183s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG nova.virt.images [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] f95294f8-b876-4b8c-8249-9cfa008dad93 was qcow2, converting to raw {{(pid=70709) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee.part /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee.converted {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee.part /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee.converted" returned: 0 in 0.365s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee.converted --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:19:20 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "9acaf5ccf3411b61d5765e9e596faddf3c91dcee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.913s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.032s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "9acaf5ccf3411b61d5765e9e596faddf3c91dcee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "9acaf5ccf3411b61d5765e9e596faddf3c91dcee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee,backing_fmt=raw /opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/disk.rescue {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee,backing_fmt=raw /opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/disk.rescue" returned: 0 in 0.060s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "9acaf5ccf3411b61d5765e9e596faddf3c91dcee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'migration_context' on Instance uuid 159a0ce2-f6b6-45bf-a743-74da642a79fe {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Start _get_guest_xml network_info=[{"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "vif_mac": "fa:16:3e:59:ff:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f95294f8-b876-4b8c-8249-9cfa008dad93', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '0789d8a1-0963-456d-b1ec-1089c4fb4fc2', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fubBYVmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '159a0ce2-f6b6-45bf-a743-74da642a79fe', 'attached_at': '', 'detached_at': '', 'volume_id': 'a08c1c10-e7e4-4fae-a760-5bff01893ad5', 'serial': 'a08c1c10-e7e4-4fae-a760-5bff01893ad5'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'resources' on Instance uuid 159a0ce2-f6b6-45bf-a743-74da642a79fe {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'numa_topology' on Instance uuid 159a0ce2-f6b6-45bf-a743-74da642a79fe {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:19:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:19:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'vcpu_model' on Instance uuid 159a0ce2-f6b6-45bf-a743-74da642a79fe {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fubBYVmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:19:21 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:19:21 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:19:21 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[50158dff-edd5-488b-bdbf-d9a6c6cb1b54]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fubBYVmz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 28 00:19:21 user nova-compute[70709]: node.name = iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:19:21 user nova-compute[70709]: node.tpgt = -1
Jul 28 00:19:21 user nova-compute[70709]: node.startup = automatic
Jul 28 00:19:21 user nova-compute[70709]: node.leading_login = No
Jul 28 00:19:21 user nova-compute[70709]: iface.iscsi_ifacename = default
Jul 28 00:19:21 user nova-compute[70709]: iface.net_ifacename = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.ipaddress = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.prefix_len = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.hwaddress = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.transport_name = tcp
Jul 28 00:19:21 user nova-compute[70709]: iface.initiatorname = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.state = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.vlan_id = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.vlan_priority = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.vlan_state = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.iface_num = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.mtu = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.port = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.bootproto = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.subnet_mask = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.gateway = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.dhcp_alt_client_id_state = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.dhcp_alt_client_id = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.dhcp_dns = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.dhcp_learn_iqn = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.dhcp_req_vendor_id_state = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.dhcp_vendor_id_state = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.dhcp_vendor_id = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.dhcp_slp_da = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.fragmentation = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.gratuitous_arp = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.incoming_forwarding = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.tos_state = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.tos = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.ttl = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.delayed_ack = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.tcp_nagle = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.tcp_wsf_state = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.tcp_wsf = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.tcp_timer_scale = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.tcp_timestamp = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.redirect = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.def_task_mgmt_timeout = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.header_digest = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.data_digest = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.immediate_data = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.initial_r2t = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.data_seq_inorder = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.data_pdu_inorder = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.erl = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.max_receive_data_len = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.first_burst_len = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.max_outstanding_r2t = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.max_burst_len = 0
Jul 28 00:19:21 user nova-compute[70709]: iface.chap_auth = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.bidi_chap = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.strict_login_compliance = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.discovery_auth = <empty>
Jul 28 00:19:21 user nova-compute[70709]: iface.discovery_logout = <empty>
Jul 28 00:19:21 user nova-compute[70709]: node.discovery_address = <empty>
Jul 28 00:19:21 user nova-compute[70709]: node.discovery_port = 0
Jul 28 00:19:21 user nova-compute[70709]: node.discovery_type = static
Jul 28 00:19:21 user nova-compute[70709]: node.session.initial_cmdsn = 0
Jul 28 00:19:21 user nova-compute[70709]: node.session.initial_login_retry_max = 8
Jul 28 00:19:21 user nova-compute[70709]: node.session.xmit_thread_priority = -20
Jul 28 00:19:21 user nova-compute[70709]: node.session.cmds_max = 128
Jul 28 00:19:21 user nova-compute[70709]: node.session.queue_depth = 32
Jul 28 00:19:21 user nova-compute[70709]: node.session.nr_sessions = 1
Jul 28 00:19:21 user nova-compute[70709]: node.session.auth.authmethod = CHAP
Jul 28 00:19:21 user nova-compute[70709]: node.session.auth.username = fubBYVmz
Jul 28 00:19:21 user nova-compute[70709]: node.session.auth.password = ***
Jul 28 00:19:21 user nova-compute[70709]: node.session.auth.username_in = <empty>
Jul 28 00:19:21 user nova-compute[70709]: node.session.auth.password_in = <empty>
Jul 28 00:19:21 user nova-compute[70709]: node.session.auth.chap_algs = MD5
Jul 28 00:19:21 user nova-compute[70709]: node.session.timeo.replacement_timeout = 120
Jul 28 00:19:21 user nova-compute[70709]: node.session.err_timeo.abort_timeout = 15
Jul 28 00:19:21 user nova-compute[70709]: node.session.err_timeo.lu_reset_timeout = 30
Jul 28 00:19:21 user nova-compute[70709]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 28 00:19:21 user nova-compute[70709]: node.session.err_timeo.host_reset_timeout = 60
Jul 28 00:19:21 user nova-compute[70709]: node.session.iscsi.FastAbort = Yes
Jul 28 00:19:21 user nova-compute[70709]: node.session.iscsi.InitialR2T = No
Jul 28 00:19:21 user nova-compute[70709]: node.session.iscsi.ImmediateData = Yes
Jul 28 00:19:21 user nova-compute[70709]: node.session.iscsi.FirstBurstLength = 262144
Jul 28 00:19:21 user nova-compute[70709]: node.session.iscsi.MaxBurstLength = 16776192
Jul 28 00:19:21 user nova-compute[70709]: node.session.iscsi.DefaultTime2Retain = 0
Jul 28 00:19:21 user nova-compute[70709]: node.session.iscsi.DefaultTime2Wait = 2
Jul 28 00:19:21 user nova-compute[70709]: node.session.iscsi.MaxConnections = 1
Jul 28 00:19:21 user nova-compute[70709]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 28 00:19:21 user nova-compute[70709]: node.session.iscsi.ERL = 0
Jul 28 00:19:21 user nova-compute[70709]: node.session.scan = manual
Jul 28 00:19:21 user nova-compute[70709]: node.session.reopen_max = 0
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].address = 172.16.0.220
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].port = 3260
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].startup = manual
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].tcp.window_size = 524288
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].tcp.type_of_service = 0
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].timeo.logout_timeout = 15
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].timeo.login_timeout = 15
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].timeo.auth_timeout = 45
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].timeo.noop_out_interval = 5
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].timeo.noop_out_timeout = 5
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].iscsi.HeaderDigest = None
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].iscsi.DataDigest = None
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].iscsi.IFMarker = No
Jul 28 00:19:21 user nova-compute[70709]: node.conn[0].iscsi.OFMarker = No
Jul 28 00:19:21 user nova-compute[70709]: # END RECORD
Jul 28 00:19:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23c3578-1c8a-4c74-8cf0-c986e69b131e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[77847ff8-aecf-4063-b074-e062c25da365]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fubBYVmz {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fubBYVmz" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b588fa2c-7f51-4d42-9f10-079d8fc0d7fe]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fubBYVmz'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e081a82-d97c-447c-b590-bfe95d893e74]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccb43d3-09dd-41d6-a2ef-a0fe0f50e17b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:19:21 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:19:21 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:19:21 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:19:21 user nova-compute[70709]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:19:21 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:19:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:19:21 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:19:21 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:19:21 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:19:21 user nova-compute[70709]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:19:21 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:19:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.206s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc691de7-1af5-49c5-90c9-ed32617607b7]: (4, ('0 0 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fubBYVmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.235s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] <== connect_volume: return (236ms) {'type': 'block', 'scsi_wwn': '26436623264633561', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436623264633561', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:19:21 user nova-compute[70709]: INFO nova.compute.manager [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Detaching volume 6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1655245855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1655245855',id=14,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-0sw5nxth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:17:45Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=159a0ce2-f6b6-45bf-a743-74da642a79fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "vif_mac": "fa:16:3e:59:ff:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "vif_mac": "fa:16:3e:59:ff:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:ff:6a,bridge_name='br-int',has_traffic_filtering=True,id=bc1adc03-972b-4d2b-a9d6-94139d5726cc,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc1adc03-97') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'pci_devices' on Instance uuid 159a0ce2-f6b6-45bf-a743-74da642a79fe {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:19:21 user nova-compute[70709]:   <uuid>159a0ce2-f6b6-45bf-a743-74da642a79fe</uuid>
Jul 28 00:19:21 user nova-compute[70709]:   <name>instance-0000000e</name>
Jul 28 00:19:21 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:19:21 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:19:21 user nova-compute[70709]:   <metadata>
Jul 28 00:19:21 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:19:21 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:19:21 user nova-compute[70709]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1655245855</nova:name>
Jul 28 00:19:21 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:19:21</nova:creationTime>
Jul 28 00:19:21 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:19:21 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:19:21 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:19:21 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:19:21 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:19:21 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:19:21 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:19:21 user nova-compute[70709]:       <nova:owner>
Jul 28 00:19:21 user nova-compute[70709]:         <nova:user uuid="fa22ce59fc4742d4ab16292a8b3d6e3f">tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member</nova:user>
Jul 28 00:19:21 user nova-compute[70709]:         <nova:project uuid="6929fa5cb2284dd8b94c387bf6e3fef6">tempest-ServerBootFromVolumeStableRescueTest-2075329923</nova:project>
Jul 28 00:19:21 user nova-compute[70709]:       </nova:owner>
Jul 28 00:19:21 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:19:21 user nova-compute[70709]:       <nova:ports>
Jul 28 00:19:21 user nova-compute[70709]:         <nova:port uuid="bc1adc03-972b-4d2b-a9d6-94139d5726cc">
Jul 28 00:19:21 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 28 00:19:21 user nova-compute[70709]:         </nova:port>
Jul 28 00:19:21 user nova-compute[70709]:       </nova:ports>
Jul 28 00:19:21 user nova-compute[70709]:     </nova:instance>
Jul 28 00:19:21 user nova-compute[70709]:   </metadata>
Jul 28 00:19:21 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:19:21 user nova-compute[70709]:     <system>
Jul 28 00:19:21 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:19:21 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:19:21 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:19:21 user nova-compute[70709]:       <entry name="serial">159a0ce2-f6b6-45bf-a743-74da642a79fe</entry>
Jul 28 00:19:21 user nova-compute[70709]:       <entry name="uuid">159a0ce2-f6b6-45bf-a743-74da642a79fe</entry>
Jul 28 00:19:21 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:19:21 user nova-compute[70709]:     </system>
Jul 28 00:19:21 user nova-compute[70709]:   </sysinfo>
Jul 28 00:19:21 user nova-compute[70709]:   <os>
Jul 28 00:19:21 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:19:21 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:19:21 user nova-compute[70709]:   </os>
Jul 28 00:19:21 user nova-compute[70709]:   <features>
Jul 28 00:19:21 user nova-compute[70709]:     <acpi/>
Jul 28 00:19:21 user nova-compute[70709]:     <apic/>
Jul 28 00:19:21 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:19:21 user nova-compute[70709]:   </features>
Jul 28 00:19:21 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:19:21 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:19:21 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:19:21 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:19:21 user nova-compute[70709]:   </clock>
Jul 28 00:19:21 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:19:21 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:19:21 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:19:21 user nova-compute[70709]:   </cpu>
Jul 28 00:19:21 user nova-compute[70709]:   <devices>
Jul 28 00:19:21 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:19:21 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:19:21 user nova-compute[70709]:       <source dev="/dev/sdb"/>
Jul 28 00:19:21 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:19:21 user nova-compute[70709]:       <serial>a08c1c10-e7e4-4fae-a760-5bff01893ad5</serial>
Jul 28 00:19:21 user nova-compute[70709]:     </disk>
Jul 28 00:19:21 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:19:21 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:19:21 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/disk.rescue"/>
Jul 28 00:19:21 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:19:21 user nova-compute[70709]:       <boot order="1"/>
Jul 28 00:19:21 user nova-compute[70709]:     </disk>
Jul 28 00:19:21 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:19:21 user nova-compute[70709]:       <mac address="fa:16:3e:59:ff:6a"/>
Jul 28 00:19:21 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:19:21 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:19:21 user nova-compute[70709]:       <target dev="tapbc1adc03-97"/>
Jul 28 00:19:21 user nova-compute[70709]:     </interface>
Jul 28 00:19:21 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:19:21 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/console.log" append="off"/>
Jul 28 00:19:21 user nova-compute[70709]:     </serial>
Jul 28 00:19:21 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:19:21 user nova-compute[70709]:     <video>
Jul 28 00:19:21 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:19:21 user nova-compute[70709]:     </video>
Jul 28 00:19:21 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:19:21 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:19:21 user nova-compute[70709]:     </rng>
Jul 28 00:19:21 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:19:21 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:19:21 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:19:21 user nova-compute[70709]:     </memballoon>
Jul 28 00:19:21 user nova-compute[70709]:   </devices>
Jul 28 00:19:21 user nova-compute[70709]: </domain>
Jul 28 00:19:21 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:19:21 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Instance destroyed successfully.
Jul 28 00:19:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No VIF found with MAC fa:16:3e:59:ff:6a, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:19:21 user nova-compute[70709]: INFO nova.virt.block_device [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Attempting to driver detach volume 6fa349e4-d68d-4414-a0da-bc1507a050f5 from mountpoint /dev/vdb
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Attempting to detach device vdb from instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:19:21 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:19:21 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:19:21 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:19:21 user nova-compute[70709]:   <serial>6fa349e4-d68d-4414-a0da-bc1507a050f5</serial>
Jul 28 00:19:21 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:19:21 user nova-compute[70709]: </disk>
Jul 28 00:19:21 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:19:21 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully detached device vdb from instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b from the persistent domain config.
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:19:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:19:21 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:19:21 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:19:21 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:19:21 user nova-compute[70709]:   <serial>6fa349e4-d68d-4414-a0da-bc1507a050f5</serial>
Jul 28 00:19:21 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:19:21 user nova-compute[70709]: </disk>
Jul 28 00:19:21 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503562.3603244, 25c6e8f8-d23d-4ec9-932b-df0471d3e41b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:19:22 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully detached device vdb from instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b from the live domain config.
Jul 28 00:19:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTkxsNLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:19:22 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1866a48-d59d-4324-9db0-267ecc0d51d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:19:22 user nova-compute[70709]: No targets found.
Jul 28 00:19:22 user nova-compute[70709]: iSNS:
Jul 28 00:19:22 user nova-compute[70709]: No targets found.
Jul 28 00:19:22 user nova-compute[70709]: STATIC:
Jul 28 00:19:22 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5
Jul 28 00:19:22 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:19:22 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:19:22 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:19:22 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:19:22 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:19:22 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c
Jul 28 00:19:22 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:19:22 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:19:22 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:19:22 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:19:22 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:19:22 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:19:22 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:19:22 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:19:22 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0
Jul 28 00:19:22 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:19:22 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:19:22 user nova-compute[70709]: FIRMWARE:
Jul 28 00:19:22 user nova-compute[70709]: No targets found.
Jul 28 00:19:22 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:19:22 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:19:22 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[686e63cb-6989-4785-bf48-47171ac0c37f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e9cb1a-6bbd-431b-a114-35c072647007]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:19:22 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:19:22 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:19:22 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:19:22 user nova-compute[70709]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:19:22 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:19:22 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:19:22 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:19:22 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:19:22 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:19:22 user nova-compute[70709]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:19:22 user nova-compute[70709]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 (non-flash)
Jul 28 00:19:22 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90176320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5'): ({'sdf'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Removing single pathed devices sdf {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada22f63-ecfd-4a2c-a446-80636023fc43]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca33c98-1696-4a0b-84cf-6d7e54eba348]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Flushing IO for device /dev/sdf {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f394e4-465f-4e12-b90e-de31ef06c11b]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bdfa8d-79e9-439e-ae94-7c8f5f8e1d45]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[65344b55-d80d-4354-ae1f-7205dd6f03a4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78c7d22-24fd-4fcc-9bff-d55ba41c2d82]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5, portal: 172.16.0.220,3260]
Jul 28 00:19:22 user nova-compute[70709]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5, portal: 172.16.0.220,3260] successful.
Jul 28 00:19:22 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa349e4-d68d-4414-a0da-bc1507a050f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1fc125-ca9b-4a51-9ddb-73a95d045436]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] <== disconnect_volume: return (375ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:19:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG nova.objects.instance [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'flavor' on Instance uuid 25c6e8f8-d23d-4ec9-932b-df0471d3e41b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3186654a-afff-4047-9112-8bb571236662 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.203s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updating instance_info_cache with network_info: [{"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-af8fee21-d47b-4583-9dcb-11ae20b73e16 req-285ccae6-78d0-4ac8-bbdb-bb9dfe4c4e85 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-af8fee21-d47b-4583-9dcb-11ae20b73e16 req-285ccae6-78d0-4ac8-bbdb-bb9dfe4c4e85 service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-af8fee21-d47b-4583-9dcb-11ae20b73e16 req-285ccae6-78d0-4ac8-bbdb-bb9dfe4c4e85 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-af8fee21-d47b-4583-9dcb-11ae20b73e16 req-285ccae6-78d0-4ac8-bbdb-bb9dfe4c4e85 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-af8fee21-d47b-4583-9dcb-11ae20b73e16 req-285ccae6-78d0-4ac8-bbdb-bb9dfe4c4e85 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:19:23 user nova-compute[70709]: WARNING nova.compute.manager [req-af8fee21-d47b-4583-9dcb-11ae20b73e16 req-285ccae6-78d0-4ac8-bbdb-bb9dfe4c4e85 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received unexpected event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with vm_state active and task_state rescuing.
Jul 28 00:19:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:19:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:19:26 user nova-compute[70709]: DEBUG nova.compute.manager [req-a26da4fd-13e3-4409-ac3c-0ec894a238be req-2b819bf8-d113-4883-8e0e-5f150316b17f service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:19:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a26da4fd-13e3-4409-ac3c-0ec894a238be req-2b819bf8-d113-4883-8e0e-5f150316b17f service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a26da4fd-13e3-4409-ac3c-0ec894a238be req-2b819bf8-d113-4883-8e0e-5f150316b17f service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a26da4fd-13e3-4409-ac3c-0ec894a238be req-2b819bf8-d113-4883-8e0e-5f150316b17f service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:26 user nova-compute[70709]: DEBUG nova.compute.manager [req-a26da4fd-13e3-4409-ac3c-0ec894a238be req-2b819bf8-d113-4883-8e0e-5f150316b17f service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:19:26 user nova-compute[70709]: WARNING nova.compute.manager [req-a26da4fd-13e3-4409-ac3c-0ec894a238be req-2b819bf8-d113-4883-8e0e-5f150316b17f service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received unexpected event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with vm_state active and task_state rescuing.
Jul 28 00:19:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for 159a0ce2-f6b6-45bf-a743-74da642a79fe due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:19:26 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503566.0433872, 159a0ce2-f6b6-45bf-a743-74da642a79fe => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:19:26 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] VM Resumed (Lifecycle Event)
Jul 28 00:19:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9291759e-49a9-41be-8cc5-2fdedc600235 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:19:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:19:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:19:26 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 28 00:19:26 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503566.043741, 159a0ce2-f6b6-45bf-a743-74da642a79fe => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:19:26 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] VM Started (Lifecycle Event)
Jul 28 00:19:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:19:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:19:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:19:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:47 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:19:47 user nova-compute[70709]: INFO nova.compute.claims [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Claim successful on node user
Jul 28 00:19:48 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:19:48 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:19:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:19:48 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Creating image(s)
Jul 28 00:19:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "/opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "/opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "/opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "360fca81b925d04bd63a6e6b8afe4a768cf785d2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "360fca81b925d04bd63a6e6b8afe4a768cf785d2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:48 user nova-compute[70709]: DEBUG nova.policy [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ed7d89a57234f37b4c578669bce4cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de9e1809a584c68905d4c0f42302f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:19:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2.part --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2.part --force-share --output=json" returned: 0 in 0.165s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:49 user nova-compute[70709]: DEBUG nova.virt.images [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] fa772b26-5a84-447b-b1b6-f26fd0dad403 was qcow2, converting to raw {{(pid=70709) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 28 00:19:49 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:19:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2.part /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2.converted {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2.part /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2.converted" returned: 0 in 0.409s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2.converted --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2.converted --force-share --output=json" returned: 0 in 0.304s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "360fca81b925d04bd63a6e6b8afe4a768cf785d2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.478s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2 --force-share --output=json" returned: 0 in 0.161s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "360fca81b925d04bd63a6e6b8afe4a768cf785d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "360fca81b925d04bd63a6e6b8afe4a768cf785d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2 --force-share --output=json" returned: 0 in 0.152s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2,backing_fmt=raw /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2,backing_fmt=raw /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk 1073741824" returned: 0 in 0.092s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "360fca81b925d04bd63a6e6b8afe4a768cf785d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2 --force-share --output=json" returned: 0 in 0.152s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Successfully created port: 65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Cannot resize image /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG nova.objects.instance [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'migration_context' on Instance uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Ensure instance console log exists: /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:52 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Successfully updated port: 65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:19:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:19:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquired lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:19:52 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:19:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:52 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:19:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-03ca5109-849b-4a10-8ed5-a44522cbfa4b req-37c0fd5b-afb0-45f7-b0ff-50d34fedc4d4 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-changed-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:19:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-03ca5109-849b-4a10-8ed5-a44522cbfa4b req-37c0fd5b-afb0-45f7-b0ff-50d34fedc4d4 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Refreshing instance network info cache due to event network-changed-65acb4df-b4f6-4c60-ae40-7c65e73fc335. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:19:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-03ca5109-849b-4a10-8ed5-a44522cbfa4b req-37c0fd5b-afb0-45f7-b0ff-50d34fedc4d4 service nova] Acquiring lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updating instance_info_cache with network_info: [{"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Releasing lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Instance network_info: |[{"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-03ca5109-849b-4a10-8ed5-a44522cbfa4b req-37c0fd5b-afb0-45f7-b0ff-50d34fedc4d4 service nova] Acquired lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.network.neutron [req-03ca5109-849b-4a10-8ed5-a44522cbfa4b req-37c0fd5b-afb0-45f7-b0ff-50d34fedc4d4 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Refreshing network info cache for port 65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Start _get_guest_xml network_info=[{"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:19:44Z,direct_url=<?>,disk_format='qcow2',id=fa772b26-5a84-447b-b1b6-f26fd0dad403,min_disk=0,min_ram=0,name='tempest-scenario-img--1983296753',owner='1de9e1809a584c68905d4c0f42302f8c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:19:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': 'fa772b26-5a84-447b-b1b6-f26fd0dad403'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:19:53 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:19:53 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:19:44Z,direct_url=<?>,disk_format='qcow2',id=fa772b26-5a84-447b-b1b6-f26fd0dad403,min_disk=0,min_ram=0,name='tempest-scenario-img--1983296753',owner='1de9e1809a584c68905d4c0f42302f8c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:19:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-581496249',display_name='tempest-TestMinimumBasicScenario-server-581496249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-581496249',id=17,image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGInO6F61l2DSAI2ovZyVDChqOqFo0h93AcA8cVc5MY/V3W3srH7250vULELir/NqHmMvUKxg5zkRriaDK8U+Au7OrnO7NCyYUZaahlOg0/rF5B85hTXPJCYAnIp9xleg==',key_name='tempest-TestMinimumBasicScenario-1965300536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1de9e1809a584c68905d4c0f42302f8c',ramdisk_id='',reservation_id='r-apa0ef0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1435468286',owner_user_name='tempest-TestMinimumBasicScenario-1435468286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:19:48Z,user_data=None,user_id='9ed7d89a57234f37b4c578669bce4cdb',uuid=30ac2ae7-04f8-407e-8aee-1c515b61d564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converting VIF {"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.objects.instance [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'pci_devices' on Instance uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:19:53 user nova-compute[70709]:   <uuid>30ac2ae7-04f8-407e-8aee-1c515b61d564</uuid>
Jul 28 00:19:53 user nova-compute[70709]:   <name>instance-00000011</name>
Jul 28 00:19:53 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:19:53 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:19:53 user nova-compute[70709]:   <metadata>
Jul 28 00:19:53 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:19:53 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:19:53 user nova-compute[70709]:       <nova:name>tempest-TestMinimumBasicScenario-server-581496249</nova:name>
Jul 28 00:19:53 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:19:53</nova:creationTime>
Jul 28 00:19:53 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:19:53 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:19:53 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:19:53 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:19:53 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:19:53 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:19:53 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:19:53 user nova-compute[70709]:       <nova:owner>
Jul 28 00:19:53 user nova-compute[70709]:         <nova:user uuid="9ed7d89a57234f37b4c578669bce4cdb">tempest-TestMinimumBasicScenario-1435468286-project-member</nova:user>
Jul 28 00:19:53 user nova-compute[70709]:         <nova:project uuid="1de9e1809a584c68905d4c0f42302f8c">tempest-TestMinimumBasicScenario-1435468286</nova:project>
Jul 28 00:19:53 user nova-compute[70709]:       </nova:owner>
Jul 28 00:19:53 user nova-compute[70709]:       <nova:root type="image" uuid="fa772b26-5a84-447b-b1b6-f26fd0dad403"/>
Jul 28 00:19:53 user nova-compute[70709]:       <nova:ports>
Jul 28 00:19:53 user nova-compute[70709]:         <nova:port uuid="65acb4df-b4f6-4c60-ae40-7c65e73fc335">
Jul 28 00:19:53 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 28 00:19:53 user nova-compute[70709]:         </nova:port>
Jul 28 00:19:53 user nova-compute[70709]:       </nova:ports>
Jul 28 00:19:53 user nova-compute[70709]:     </nova:instance>
Jul 28 00:19:53 user nova-compute[70709]:   </metadata>
Jul 28 00:19:53 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:19:53 user nova-compute[70709]:     <system>
Jul 28 00:19:53 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:19:53 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:19:53 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:19:53 user nova-compute[70709]:       <entry name="serial">30ac2ae7-04f8-407e-8aee-1c515b61d564</entry>
Jul 28 00:19:53 user nova-compute[70709]:       <entry name="uuid">30ac2ae7-04f8-407e-8aee-1c515b61d564</entry>
Jul 28 00:19:53 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:19:53 user nova-compute[70709]:     </system>
Jul 28 00:19:53 user nova-compute[70709]:   </sysinfo>
Jul 28 00:19:53 user nova-compute[70709]:   <os>
Jul 28 00:19:53 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:19:53 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:19:53 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:19:53 user nova-compute[70709]:   </os>
Jul 28 00:19:53 user nova-compute[70709]:   <features>
Jul 28 00:19:53 user nova-compute[70709]:     <acpi/>
Jul 28 00:19:53 user nova-compute[70709]:     <apic/>
Jul 28 00:19:53 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:19:53 user nova-compute[70709]:   </features>
Jul 28 00:19:53 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:19:53 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:19:53 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:19:53 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:19:53 user nova-compute[70709]:   </clock>
Jul 28 00:19:53 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:19:53 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:19:53 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:19:53 user nova-compute[70709]:   </cpu>
Jul 28 00:19:53 user nova-compute[70709]:   <devices>
Jul 28 00:19:53 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:19:53 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:19:53 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk"/>
Jul 28 00:19:53 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:19:53 user nova-compute[70709]:     </disk>
Jul 28 00:19:53 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:19:53 user nova-compute[70709]:       <mac address="fa:16:3e:6d:4b:f5"/>
Jul 28 00:19:53 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:19:53 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:19:53 user nova-compute[70709]:       <target dev="tap65acb4df-b4"/>
Jul 28 00:19:53 user nova-compute[70709]:     </interface>
Jul 28 00:19:53 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:19:53 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/console.log" append="off"/>
Jul 28 00:19:53 user nova-compute[70709]:     </serial>
Jul 28 00:19:53 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:19:53 user nova-compute[70709]:     <video>
Jul 28 00:19:53 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:19:53 user nova-compute[70709]:     </video>
Jul 28 00:19:53 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:19:53 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:19:53 user nova-compute[70709]:     </rng>
Jul 28 00:19:53 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:19:53 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:19:53 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:19:53 user nova-compute[70709]:     </memballoon>
Jul 28 00:19:53 user nova-compute[70709]:   </devices>
Jul 28 00:19:53 user nova-compute[70709]: </domain>
Jul 28 00:19:53 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-581496249',display_name='tempest-TestMinimumBasicScenario-server-581496249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-581496249',id=17,image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGInO6F61l2DSAI2ovZyVDChqOqFo0h93AcA8cVc5MY/V3W3srH7250vULELir/NqHmMvUKxg5zkRriaDK8U+Au7OrnO7NCyYUZaahlOg0/rF5B85hTXPJCYAnIp9xleg==',key_name='tempest-TestMinimumBasicScenario-1965300536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1de9e1809a584c68905d4c0f42302f8c',ramdisk_id='',reservation_id='r-apa0ef0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1435468286',owner_user_name='tempest-TestMinimumBasicScenario-1435468286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:19:48Z,user_data=None,user_id='9ed7d89a57234f37b4c578669bce4cdb',uuid=30ac2ae7-04f8-407e-8aee-1c515b61d564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converting VIF {"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG os_vif [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65acb4df-b4, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65acb4df-b4, col_values=(('external_ids', {'iface-id': '65acb4df-b4f6-4c60-ae40-7c65e73fc335', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:4b:f5', 'vm-uuid': '30ac2ae7-04f8-407e-8aee-1c515b61d564'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:53 user nova-compute[70709]: INFO os_vif [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4')
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] No VIF found with MAC fa:16:3e:6d:4b:f5, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.network.neutron [req-03ca5109-849b-4a10-8ed5-a44522cbfa4b req-37c0fd5b-afb0-45f7-b0ff-50d34fedc4d4 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updated VIF entry in instance network info cache for port 65acb4df-b4f6-4c60-ae40-7c65e73fc335. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG nova.network.neutron [req-03ca5109-849b-4a10-8ed5-a44522cbfa4b req-37c0fd5b-afb0-45f7-b0ff-50d34fedc4d4 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updating instance_info_cache with network_info: [{"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:19:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-03ca5109-849b-4a10-8ed5-a44522cbfa4b req-37c0fd5b-afb0-45f7-b0ff-50d34fedc4d4 service nova] Releasing lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:19:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:55 user nova-compute[70709]: DEBUG nova.compute.manager [req-901bcbf3-d642-4c57-a4cf-20852fc2bcaa req-c8124759-6ccf-441e-81b7-bad35ef216dd service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:19:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-901bcbf3-d642-4c57-a4cf-20852fc2bcaa req-c8124759-6ccf-441e-81b7-bad35ef216dd service nova] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-901bcbf3-d642-4c57-a4cf-20852fc2bcaa req-c8124759-6ccf-441e-81b7-bad35ef216dd service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-901bcbf3-d642-4c57-a4cf-20852fc2bcaa req-c8124759-6ccf-441e-81b7-bad35ef216dd service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:55 user nova-compute[70709]: DEBUG nova.compute.manager [req-901bcbf3-d642-4c57-a4cf-20852fc2bcaa req-c8124759-6ccf-441e-81b7-bad35ef216dd service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] No waiting events found dispatching network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:19:55 user nova-compute[70709]: WARNING nova.compute.manager [req-901bcbf3-d642-4c57-a4cf-20852fc2bcaa req-c8124759-6ccf-441e-81b7-bad35ef216dd service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received unexpected event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 for instance with vm_state building and task_state spawning.
Jul 28 00:19:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-809eae71-c612-4b17-b055-eb802314b5c7 req-72b52cd8-d11f-4c63-a42c-03400ddee1ce service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-809eae71-c612-4b17-b055-eb802314b5c7 req-72b52cd8-d11f-4c63-a42c-03400ddee1ce service nova] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-809eae71-c612-4b17-b055-eb802314b5c7 req-72b52cd8-d11f-4c63-a42c-03400ddee1ce service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-809eae71-c612-4b17-b055-eb802314b5c7 req-72b52cd8-d11f-4c63-a42c-03400ddee1ce service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-809eae71-c612-4b17-b055-eb802314b5c7 req-72b52cd8-d11f-4c63-a42c-03400ddee1ce service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] No waiting events found dispatching network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:19:57 user nova-compute[70709]: WARNING nova.compute.manager [req-809eae71-c612-4b17-b055-eb802314b5c7 req-72b52cd8-d11f-4c63-a42c-03400ddee1ce service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received unexpected event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 for instance with vm_state building and task_state spawning.
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503597.3477376, 30ac2ae7-04f8-407e-8aee-1c515b61d564 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:19:57 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] VM Resumed (Lifecycle Event)
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:19:57 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Instance spawned successfully.
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:19:57 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503597.3493207, 30ac2ae7-04f8-407e-8aee-1c515b61d564 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:19:57 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] VM Started (Lifecycle Event)
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:19:57 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:19:57 user nova-compute[70709]: INFO nova.compute.manager [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Took 9.03 seconds to spawn the instance on the hypervisor.
Jul 28 00:19:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:19:57 user nova-compute[70709]: INFO nova.compute.manager [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Took 9.97 seconds to build instance.
Jul 28 00:19:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ed1c85da-9f28-4036-a982-6b81ab36dcdf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.079s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:19:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 00:20:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 00:20:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:12 user nova-compute[70709]: INFO nova.compute.manager [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Terminating instance
Jul 28 00:20:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-72cf08ff-7153-4bcd-828f-cddba567a33e req-172cca5c-7014-4666-9130-1154c874fc5a service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Received event network-vif-unplugged-98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-72cf08ff-7153-4bcd-828f-cddba567a33e req-172cca5c-7014-4666-9130-1154c874fc5a service nova] Acquiring lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-72cf08ff-7153-4bcd-828f-cddba567a33e req-172cca5c-7014-4666-9130-1154c874fc5a service nova] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-72cf08ff-7153-4bcd-828f-cddba567a33e req-172cca5c-7014-4666-9130-1154c874fc5a service nova] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-72cf08ff-7153-4bcd-828f-cddba567a33e req-172cca5c-7014-4666-9130-1154c874fc5a service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] No waiting events found dispatching network-vif-unplugged-98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-72cf08ff-7153-4bcd-828f-cddba567a33e req-172cca5c-7014-4666-9130-1154c874fc5a service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Received event network-vif-unplugged-98291a12-0469-487a-8016-155a23415be0 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:12 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Instance destroyed successfully.
Jul 28 00:20:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'resources' on Instance uuid 25c6e8f8-d23d-4ec9-932b-df0471d3e41b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1244498967',display_name='tempest-AttachVolumeNegativeTest-server-1244498967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1244498967',id=6,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItfbsS9v9Q1EeY/KlrE8uwiS51IntHw9BgxttLdGuVPv+h/RK7t+qUZDd/g1FTG02L+NVWBFUwAA2d7QA8d6NWX3RJnG26WJ5Kkj/TtPwNLCCKgijc1C8TqA8YaYTcdtg==',key_name='tempest-keypair-1094487479',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-ptepngd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=25c6e8f8-d23d-4ec9-932b-df0471d3e41b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98291a12-0469-487a-8016-155a23415be0", "address": "fa:16:3e:d5:5f:d5", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98291a12-04", "ovs_interfaceid": "98291a12-0469-487a-8016-155a23415be0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "98291a12-0469-487a-8016-155a23415be0", "address": "fa:16:3e:d5:5f:d5", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98291a12-04", "ovs_interfaceid": "98291a12-0469-487a-8016-155a23415be0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=98291a12-0469-487a-8016-155a23415be0,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98291a12-04') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG os_vif [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=98291a12-0469-487a-8016-155a23415be0,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98291a12-04') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98291a12-04, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:12 user nova-compute[70709]: INFO os_vif [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=98291a12-0469-487a-8016-155a23415be0,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98291a12-04')
Jul 28 00:20:12 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Deleting instance files /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b_del
Jul 28 00:20:12 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Deletion of /opt/stack/data/nova/instances/25c6e8f8-d23d-4ec9-932b-df0471d3e41b_del complete
Jul 28 00:20:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:20:12 user nova-compute[70709]: INFO nova.compute.manager [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 28 00:20:12 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:20:12 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG nova.compute.manager [req-e35ca94d-05a7-4d16-91c7-c72f7c24d9e1 req-f281b60e-1592-4542-882d-508e9d1888ba service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Received event network-vif-deleted-98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:13 user nova-compute[70709]: INFO nova.compute.manager [req-e35ca94d-05a7-4d16-91c7-c72f7c24d9e1 req-f281b60e-1592-4542-882d-508e9d1888ba service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Neutron deleted interface 98291a12-0469-487a-8016-155a23415be0; detaching it from the instance and deleting it from the info cache
Jul 28 00:20:13 user nova-compute[70709]: DEBUG nova.network.neutron [req-e35ca94d-05a7-4d16-91c7-c72f7c24d9e1 req-f281b60e-1592-4542-882d-508e9d1888ba service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:13 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:13 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Took 1.04 seconds to deallocate network for instance.
Jul 28 00:20:13 user nova-compute[70709]: DEBUG nova.compute.manager [req-e35ca94d-05a7-4d16-91c7-c72f7c24d9e1 req-f281b60e-1592-4542-882d-508e9d1888ba service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Detach interface failed, port_id=98291a12-0469-487a-8016-155a23415be0, reason: Instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-cf3ad081-07b3-4b2e-8c5f-a638c0573313 req-173280a6-1ba6-426f-a3ba-4d7118fe8c13 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Received event network-vif-plugged-98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cf3ad081-07b3-4b2e-8c5f-a638c0573313 req-173280a6-1ba6-426f-a3ba-4d7118fe8c13 service nova] Acquiring lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cf3ad081-07b3-4b2e-8c5f-a638c0573313 req-173280a6-1ba6-426f-a3ba-4d7118fe8c13 service nova] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cf3ad081-07b3-4b2e-8c5f-a638c0573313 req-173280a6-1ba6-426f-a3ba-4d7118fe8c13 service nova] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-cf3ad081-07b3-4b2e-8c5f-a638c0573313 req-173280a6-1ba6-426f-a3ba-4d7118fe8c13 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] No waiting events found dispatching network-vif-plugged-98291a12-0469-487a-8016-155a23415be0 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:14 user nova-compute[70709]: WARNING nova.compute.manager [req-cf3ad081-07b3-4b2e-8c5f-a638c0573313 req-173280a6-1ba6-426f-a3ba-4d7118fe8c13 service nova] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Received unexpected event network-vif-plugged-98291a12-0469-487a-8016-155a23415be0 for instance with vm_state deleted and task_state None.
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:14 user nova-compute[70709]: INFO nova.compute.manager [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Detaching volume d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:20:14 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:20:14 user nova-compute[70709]: INFO nova.virt.block_device [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Attempting to driver detach volume d16451a8-1aa5-4c9d-9856-f1f0de94a874 from mountpoint /dev/vdb
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Attempting to detach device vdb from instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:20:14 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:20:14 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:20:14 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:20:14 user nova-compute[70709]:   <serial>d16451a8-1aa5-4c9d-9856-f1f0de94a874</serial>
Jul 28 00:20:14 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 28 00:20:14 user nova-compute[70709]: </disk>
Jul 28 00:20:14 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.607s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:14 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully detached device vdb from instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee from the persistent domain config.
Jul 28 00:20:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:20:14 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:20:14 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:20:14 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:20:14 user nova-compute[70709]:   <serial>d16451a8-1aa5-4c9d-9856-f1f0de94a874</serial>
Jul 28 00:20:14 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 28 00:20:14 user nova-compute[70709]: </disk>
Jul 28 00:20:14 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:20:14 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Deleted allocations for instance 25c6e8f8-d23d-4ec9-932b-df0471d3e41b
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-43dd70f9-5679-445c-b118-f08c0e55f1b7 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "25c6e8f8-d23d-4ec9-932b-df0471d3e41b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.791s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:20:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503615.1233723, 2bb828f4-bb7d-4754-bcaa-38f2954b8eee => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully detached device vdb from instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee from the live domain config.
Jul 28 00:20:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnkLoDVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:20:15 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa41751e-e1df-4281-af02-9bcb201d9948]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:20:15 user nova-compute[70709]: No targets found.
Jul 28 00:20:15 user nova-compute[70709]: iSNS:
Jul 28 00:20:15 user nova-compute[70709]: No targets found.
Jul 28 00:20:15 user nova-compute[70709]: STATIC:
Jul 28 00:20:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:20:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c
Jul 28 00:20:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874
Jul 28 00:20:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:20:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0
Jul 28 00:20:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:15 user nova-compute[70709]: FIRMWARE:
Jul 28 00:20:15 user nova-compute[70709]: No targets found.
Jul 28 00:20:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:20:15 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:20:15 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbb6064-0e7c-4734-b413-2cf7f9818428]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4980ee-cff1-4923-a7fb-9303a502488e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:15 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:20:15 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:15 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:15 user nova-compute[70709]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:15 user nova-compute[70709]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 (non-flash)
Jul 28 00:20:15 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:15 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:15 user nova-compute[70709]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b9d0b8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874'): ({'sdd'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Removing single pathed devices sdd {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0fc263-7663-4774-9bf0-9270d4705cff]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdb63f9-8029-4838-a337-fd6a0c735352]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flushing IO for device /dev/sdd {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5971865e-66aa-4562-beec-53d1b57ddc9c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e882c31-d3cb-444e-ad68-5d8fb75f5154]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3e428a-0462-4ed9-b56e-7dc6cdd17cd5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[69093e40-7c0d-4532-ad58-ceef365a7d47]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260]
Jul 28 00:20:15 user nova-compute[70709]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874, portal: 172.16.0.220,3260] successful.
Jul 28 00:20:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16451a8-1aa5-4c9d-9856-f1f0de94a874 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de9841b-6f96-445d-a024-c6cb5f05ce8e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] <== disconnect_volume: return (393ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:20:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG nova.objects.instance [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:20:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:20:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:20:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7160MB free_disk=25.226947784423828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f2c7a7b0-adab-4134-a0ac-aa831483158b tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c0a95579-0c80-4048-a903-e21288de57cd tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.371s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f2c7a7b0-adab-4134-a0ac-aa831483158b tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.014s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f2c7a7b0-adab-4134-a0ac-aa831483158b tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f2c7a7b0-adab-4134-a0ac-aa831483158b tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70709) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG nova.objects.instance [None req-f2c7a7b0-adab-4134-a0ac-aa831483158b tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Applying migration context for instance df55bbd3-31ab-42f8-9a71-4ed8e3c4428c as it has an incoming, in-progress migration fd6c45dd-89c9-4228-b535-c46894436656. Migration status is finished {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 28 00:20:16 user nova-compute[70709]: INFO nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating resource usage from migration fd6c45dd-89c9-4228-b535-c46894436656
Jul 28 00:20:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Migration fd6c45dd-89c9-4228-b535-c46894436656 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance df55bbd3-31ab-42f8-9a71-4ed8e3c4428c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 8168aa39-afce-4c9e-ba76-78a760767357 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance c6297718-d595-4657-aa32-aa75bffdf955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 30ac2ae7-04f8-407e-8aee-1c515b61d564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-e867b39b-643e-425d-9cc1-866e0aedd0a0 req-ed2e9a3b-191f-40a3-9c5c-804f555e332c service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-unplugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e867b39b-643e-425d-9cc1-866e0aedd0a0 req-ed2e9a3b-191f-40a3-9c5c-804f555e332c service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e867b39b-643e-425d-9cc1-866e0aedd0a0 req-ed2e9a3b-191f-40a3-9c5c-804f555e332c service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e867b39b-643e-425d-9cc1-866e0aedd0a0 req-ed2e9a3b-191f-40a3-9c5c-804f555e332c service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-e867b39b-643e-425d-9cc1-866e0aedd0a0 req-ed2e9a3b-191f-40a3-9c5c-804f555e332c service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-unplugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:17 user nova-compute[70709]: WARNING nova.compute.manager [req-e867b39b-643e-425d-9cc1-866e0aedd0a0 req-ed2e9a3b-191f-40a3-9c5c-804f555e332c service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received unexpected event network-vif-unplugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with vm_state active and task_state powering-off.
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.858s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance destroyed successfully.
Jul 28 00:20:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f2c7a7b0-adab-4134-a0ac-aa831483158b tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:20:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f2c7a7b0-adab-4134-a0ac-aa831483158b tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.302s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:18 user nova-compute[70709]: DEBUG nova.network.neutron [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Port 7e92340f-f93d-411f-8e69-2a75164b3679 binding to destination host user is already ACTIVE {{(pid=70709) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 28 00:20:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquired lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:18 user nova-compute[70709]: DEBUG nova.network.neutron [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:20:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG nova.network.neutron [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating instance_info_cache with network_info: [{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Releasing lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Creating tmpfile /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/tmpkn5igfcn to verify with other compute node that the instance is on the same shared storage. {{(pid=70709) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-f1688ebe-a46d-4d17-9660-20d5bf2814ae req-287bdeb3-5b9c-401c-b9e1-38a422fde341 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f1688ebe-a46d-4d17-9660-20d5bf2814ae req-287bdeb3-5b9c-401c-b9e1-38a422fde341 service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f1688ebe-a46d-4d17-9660-20d5bf2814ae req-287bdeb3-5b9c-401c-b9e1-38a422fde341 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f1688ebe-a46d-4d17-9660-20d5bf2814ae req-287bdeb3-5b9c-401c-b9e1-38a422fde341 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-f1688ebe-a46d-4d17-9660-20d5bf2814ae req-287bdeb3-5b9c-401c-b9e1-38a422fde341 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:19 user nova-compute[70709]: WARNING nova.compute.manager [req-f1688ebe-a46d-4d17-9660-20d5bf2814ae req-287bdeb3-5b9c-401c-b9e1-38a422fde341 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received unexpected event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with vm_state stopped and task_state None.
Jul 28 00:20:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updating instance_info_cache with network_info: [{"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:20:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:20 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance destroyed successfully.
Jul 28 00:20:20 user nova-compute[70709]: DEBUG nova.objects.instance [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'resources' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1488928010',display_name='tempest-ServerActionsTestOtherB-server-1488928010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1488928010',id=3,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnNPKIDRaM81k628x28KRrACS+k9io0IYMr8rKnbfV6R9PEGedJ0uPueig7JixSq/MVd5cruSs8PGo9MLWndddj6j9yk5HzD1hsNyADvhHRJFhgOMMfk3L2UUGGtvzDbA==',key_name='tempest-keypair-458737518',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:19:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8a7ed8f269b4e989727baa24619d774',ramdisk_id='',reservation_id='r-0vm06iql',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900188209',owner_user_name='tempest-ServerActionsTestOtherB-1900188209-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:19:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc9412c0c5a345399b7cc2ff4540535d',uuid=df55bbd3-31ab-42f8-9a71-4ed8e3c4428c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converting VIF {"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_vif [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e92340f-f9, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:20 user nova-compute[70709]: INFO os_vif [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9')
Jul 28 00:20:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaVgHnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:20:20 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa95f54-5fc5-442c-9ebb-94ffef0b5860]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:20:20 user nova-compute[70709]: No targets found.
Jul 28 00:20:20 user nova-compute[70709]: iSNS:
Jul 28 00:20:20 user nova-compute[70709]: No targets found.
Jul 28 00:20:20 user nova-compute[70709]: STATIC:
Jul 28 00:20:20 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:20:20 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:20 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:20 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c
Jul 28 00:20:20 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:20 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:20 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:20:20 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:20 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:20 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0
Jul 28 00:20:20 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:20 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:20 user nova-compute[70709]: FIRMWARE:
Jul 28 00:20:20 user nova-compute[70709]: No targets found.
Jul 28 00:20:20 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:20:20 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:20:20 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac5f70f-c2b5-47c7-a725-fd08c4c8dff0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e17ecf6-250b-4c8a-90c1-0eeda7e28d09]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:20 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:20 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:20 user nova-compute[70709]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:20 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:20 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:20 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:20 user nova-compute[70709]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:20 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90175240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c'): ({'sdg'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Removing single pathed devices sdg {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8484a6a8-f0ce-4780-8a79-2f610a077cf0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fa1710-ef81-4322-aab7-cde564075eb1]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Flushing IO for device /dev/sdg {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec77a0e-4841-4897-a2e1-cc54bcd3897e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.064s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc21862-95d0-4831-959f-9b3d997c091a]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] SCSI volumes sdg have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcccef6-6bc9-4473-8a3e-65e238c9d7ae]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7af79bb-255d-4222-aa4c-65b757de14bd]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]
Jul 28 00:20:20 user nova-compute[70709]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.
Jul 28 00:20:20 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac7ff2e-6663-42de-96c4-8efc1fd362a0]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] <== disconnect_volume: return (369ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:20:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-unplugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-unplugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:21 user nova-compute[70709]: WARNING nova.compute.manager [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received unexpected event network-vif-unplugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with vm_state resized and task_state resize_reverting.
Jul 28 00:20:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:21 user nova-compute[70709]: WARNING nova.compute.manager [req-19e38e14-cfc3-44e4-b71f-74b5767b0ea1 req-befe326a-3d52-42eb-b5e2-3ab30f7d9db6 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received unexpected event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with vm_state resized and task_state resize_reverting.
Jul 28 00:20:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG nova.objects.instance [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'migration_context' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 00:20:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:22 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:20:22 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:20:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.604s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:22 user nova-compute[70709]: INFO nova.compute.manager [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Swapping old allocation on dict_keys(['4612f42c-a702-4177-9388-c9bc6a4c0da1']) held by migration fd6c45dd-89c9-4228-b535-c46894436656 for instance
Jul 28 00:20:22 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Overwriting current allocation {'allocations': {'4612f42c-a702-4177-9388-c9bc6a4c0da1': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': 'c8a7ed8f269b4e989727baa24619d774', 'user_id': 'fc9412c0c5a345399b7cc2ff4540535d', 'consumer_generation': 1} on consumer df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 28 00:20:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquired lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:22 user nova-compute[70709]: DEBUG nova.network.neutron [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating instance_info_cache with network_info: [{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Releasing lock "refresh_cache-df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG os_brick.utils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3498f0f-582a-49b2-aad3-c4a110a4b488]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[673fcc8d-2e71-4929-a642-b983670fc1e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1847c1-e465-4b20-8dd0-63835c8f7efe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b168a4b-5708-44de-a0d0-581c4bab2db5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:20:23 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:20:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac81f547-98c9-4491-9044-75d95e6d97f4]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:20:23 user nova-compute[70709]: DEBUG os_brick.utils [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:20:24 user nova-compute[70709]: INFO nova.compute.manager [None req-17a752d4-a930-4fc6-aa12-fea4c7edaa48 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Unrescuing
Jul 28 00:20:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-17a752d4-a930-4fc6-aa12-fea4c7edaa48 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-17a752d4-a930-4fc6-aa12-fea4c7edaa48 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquired lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:24 user nova-compute[70709]: DEBUG nova.network.neutron [None req-17a752d4-a930-4fc6-aa12-fea4c7edaa48 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:20:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-fe78a57e-b842-4cc4-b1e3-2eb08fabaeb6 req-c14fd7fd-bd59-401b-b41f-50a6be8641f8 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Received event network-changed-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-fe78a57e-b842-4cc4-b1e3-2eb08fabaeb6 req-c14fd7fd-bd59-401b-b41f-50a6be8641f8 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Refreshing instance network info cache due to event network-changed-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:20:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fe78a57e-b842-4cc4-b1e3-2eb08fabaeb6 req-c14fd7fd-bd59-401b-b41f-50a6be8641f8 service nova] Acquiring lock "refresh_cache-8168aa39-afce-4c9e-ba76-78a760767357" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fe78a57e-b842-4cc4-b1e3-2eb08fabaeb6 req-c14fd7fd-bd59-401b-b41f-50a6be8641f8 service nova] Acquired lock "refresh_cache-8168aa39-afce-4c9e-ba76-78a760767357" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:25 user nova-compute[70709]: DEBUG nova.network.neutron [req-fe78a57e-b842-4cc4-b1e3-2eb08fabaeb6 req-c14fd7fd-bd59-401b-b41f-50a6be8641f8 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Refreshing network info cache for port b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:20:26 user nova-compute[70709]: DEBUG nova.network.neutron [req-fe78a57e-b842-4cc4-b1e3-2eb08fabaeb6 req-c14fd7fd-bd59-401b-b41f-50a6be8641f8 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Updated VIF entry in instance network info cache for port b3a39ad7-b4fb-42f8-afc2-038ad99f2f47. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:20:26 user nova-compute[70709]: DEBUG nova.network.neutron [req-fe78a57e-b842-4cc4-b1e3-2eb08fabaeb6 req-c14fd7fd-bd59-401b-b41f-50a6be8641f8 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Updating instance_info_cache with network_info: [{"id": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "address": "fa:16:3e:41:8c:f9", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a39ad7-b4", "ovs_interfaceid": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fe78a57e-b842-4cc4-b1e3-2eb08fabaeb6 req-c14fd7fd-bd59-401b-b41f-50a6be8641f8 service nova] Releasing lock "refresh_cache-8168aa39-afce-4c9e-ba76-78a760767357" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:26 user nova-compute[70709]: DEBUG nova.network.neutron [None req-17a752d4-a930-4fc6-aa12-fea4c7edaa48 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updating instance_info_cache with network_info: [{"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-17a752d4-a930-4fc6-aa12-fea4c7edaa48 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Releasing lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:26 user nova-compute[70709]: DEBUG nova.objects.instance [None req-17a752d4-a930-4fc6-aa12-fea4c7edaa48 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'flavor' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-9873e89e-2a4f-4fd4-b431-95466cb618de req-9c6edde0-fe0a-4162-82b6-a529baa28b83 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-changed-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-9873e89e-2a4f-4fd4-b431-95466cb618de req-9c6edde0-fe0a-4162-82b6-a529baa28b83 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Refreshing instance network info cache due to event network-changed-84dc7a3e-6f63-4ff1-8689-38f607df3ae6. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9873e89e-2a4f-4fd4-b431-95466cb618de req-9c6edde0-fe0a-4162-82b6-a529baa28b83 service nova] Acquiring lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9873e89e-2a4f-4fd4-b431-95466cb618de req-9c6edde0-fe0a-4162-82b6-a529baa28b83 service nova] Acquired lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.network.neutron [req-9873e89e-2a4f-4fd4-b431-95466cb618de req-9c6edde0-fe0a-4162-82b6-a529baa28b83 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Refreshing network info cache for port 84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:27 user nova-compute[70709]: WARNING nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 39bc08e9-7b3c-4698-921e-429823996ce1 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 159a0ce2-f6b6-45bf-a743-74da642a79fe {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 8168aa39-afce-4c9e-ba76-78a760767357 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid c6297718-d595-4657-aa32-aa75bffdf955 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:27 user nova-compute[70709]: INFO nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "39bc08e9-7b3c-4698-921e-429823996ce1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "39bc08e9-7b3c-4698-921e-429823996ce1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:27 user nova-compute[70709]: INFO nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "8168aa39-afce-4c9e-ba76-78a760767357" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "8168aa39-afce-4c9e-ba76-78a760767357" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "c6297718-d595-4657-aa32-aa75bffdf955" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-958bb012-8166-4a1f-97c3-124bb90cda1f req-41cda285-2c3e-4207-998e-85543e384dd2 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-unplugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-958bb012-8166-4a1f-97c3-124bb90cda1f req-41cda285-2c3e-4207-998e-85543e384dd2 service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-958bb012-8166-4a1f-97c3-124bb90cda1f req-41cda285-2c3e-4207-998e-85543e384dd2 service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-958bb012-8166-4a1f-97c3-124bb90cda1f req-41cda285-2c3e-4207-998e-85543e384dd2 service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-958bb012-8166-4a1f-97c3-124bb90cda1f req-41cda285-2c3e-4207-998e-85543e384dd2 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-unplugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:27 user nova-compute[70709]: WARNING nova.compute.manager [req-958bb012-8166-4a1f-97c3-124bb90cda1f req-41cda285-2c3e-4207-998e-85543e384dd2 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received unexpected event network-vif-unplugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "39bc08e9-7b3c-4698-921e-429823996ce1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "8168aa39-afce-4c9e-ba76-78a760767357" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "c6297718-d595-4657-aa32-aa75bffdf955" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:27 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Instance destroyed successfully.
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503612.7892337, 25c6e8f8-d23d-4ec9-932b-df0471d3e41b => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:20:27 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] VM Stopped (Lifecycle Event)
Jul 28 00:20:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d012c06f-8fd7-43fb-9fe1-6213e21237bc None None] [instance: 25c6e8f8-d23d-4ec9-932b-df0471d3e41b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:20:28 user nova-compute[70709]: DEBUG nova.network.neutron [req-9873e89e-2a4f-4fd4-b431-95466cb618de req-9c6edde0-fe0a-4162-82b6-a529baa28b83 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updated VIF entry in instance network info cache for port 84dc7a3e-6f63-4ff1-8689-38f607df3ae6. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:20:28 user nova-compute[70709]: DEBUG nova.network.neutron [req-9873e89e-2a4f-4fd4-b431-95466cb618de req-9c6edde0-fe0a-4162-82b6-a529baa28b83 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updating instance_info_cache with network_info: [{"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9873e89e-2a4f-4fd4-b431-95466cb618de req-9c6edde0-fe0a-4162-82b6-a529baa28b83 service nova] Releasing lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "8168aa39-afce-4c9e-ba76-78a760767357" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG nova.objects.instance [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lazy-loading 'flavor' on Instance uuid 8168aa39-afce-4c9e-ba76-78a760767357 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "8168aa39-afce-4c9e-ba76-78a760767357" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:29 user nova-compute[70709]: INFO nova.compute.manager [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Attaching volume 7203354c-68f0-40c4-8f8c-254dd1622438 to /dev/vdb
Jul 28 00:20:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:29 user nova-compute[70709]: WARNING nova.compute.manager [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received unexpected event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:20:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:29 user nova-compute[70709]: WARNING nova.compute.manager [req-a8a54cab-4292-48a4-b319-4d3e3c69e292 req-ba8dea09-a583-4751-b668-85cd2918e1ef service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received unexpected event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:20:29 user nova-compute[70709]: DEBUG os_brick.utils [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef45948-1312-468b-85fb-4fb41f25bac7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[33622965-84ce-418f-a9be-097d65ea83fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c0436d-d0ac-4863-8ee4-bedc60f867a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fee685-b86b-4971-ac6f-328ee877f4db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:20:29 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6365fc03-8726-47b6-be4d-5502dd72a753]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG os_brick.utils [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Updating existing volume attachment record: 9708db14-9832-414d-b6d4-0141130b94b4 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-b7e42728-4c0a-4b17-bfcd-788e61152785 req-ec956173-85e9-43ba-ba05-9d0cac570062 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-changed-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-b7e42728-4c0a-4b17-bfcd-788e61152785 req-ec956173-85e9-43ba-ba05-9d0cac570062 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Refreshing instance network info cache due to event network-changed-84dc7a3e-6f63-4ff1-8689-38f607df3ae6. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b7e42728-4c0a-4b17-bfcd-788e61152785 req-ec956173-85e9-43ba-ba05-9d0cac570062 service nova] Acquiring lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b7e42728-4c0a-4b17-bfcd-788e61152785 req-ec956173-85e9-43ba-ba05-9d0cac570062 service nova] Acquired lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG nova.network.neutron [req-b7e42728-4c0a-4b17-bfcd-788e61152785 req-ec956173-85e9-43ba-ba05-9d0cac570062 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Refreshing network info cache for port 84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:30 user nova-compute[70709]: DEBUG nova.network.neutron [req-b7e42728-4c0a-4b17-bfcd-788e61152785 req-ec956173-85e9-43ba-ba05-9d0cac570062 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updated VIF entry in instance network info cache for port 84dc7a3e-6f63-4ff1-8689-38f607df3ae6. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:20:30 user nova-compute[70709]: DEBUG nova.network.neutron [req-b7e42728-4c0a-4b17-bfcd-788e61152785 req-ec956173-85e9-43ba-ba05-9d0cac570062 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updating instance_info_cache with network_info: [{"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b7e42728-4c0a-4b17-bfcd-788e61152785 req-ec956173-85e9-43ba-ba05-9d0cac570062 service nova] Releasing lock "refresh_cache-a585b419-b9f5-4bd6-bbc9-cdfc4e732712" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:20:31 user nova-compute[70709]: INFO nova.compute.claims [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Claim successful on node user
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Starting finish_revert_migration {{(pid=70709) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-17a752d4-a930-4fc6-aa12-fea4c7edaa48 tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for a585b419-b9f5-4bd6-bbc9-cdfc4e732712 due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503631.5224679, a585b419-b9f5-4bd6-bbc9-cdfc4e732712 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:20:31 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] VM Resumed (Lifecycle Event)
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Start _get_guest_xml network_info=[{"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '1c86b09e-dc6f-45aa-b77f-04e6b06f35e1', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaVgHnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'df55bbd3-31ab-42f8-9a71-4ed8e3c4428c', 'attached_at': '2023-07-28T00:20:31.000000', 'detached_at': '', 'volume_id': '86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'serial': '86b782c7-df0d-4e2a-8b05-6dba869dde7c'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-883c5a2f-5b56-4d4a-b31f-105cfaaf2b8e req-bd3fe464-ec84-4183-8be8-39fbda565915 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-883c5a2f-5b56-4d4a-b31f-105cfaaf2b8e req-bd3fe464-ec84-4183-8be8-39fbda565915 service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-883c5a2f-5b56-4d4a-b31f-105cfaaf2b8e req-bd3fe464-ec84-4183-8be8-39fbda565915 service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-883c5a2f-5b56-4d4a-b31f-105cfaaf2b8e req-bd3fe464-ec84-4183-8be8-39fbda565915 service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-883c5a2f-5b56-4d4a-b31f-105cfaaf2b8e req-bd3fe464-ec84-4183-8be8-39fbda565915 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:31 user nova-compute[70709]: WARNING nova.compute.manager [req-883c5a2f-5b56-4d4a-b31f-105cfaaf2b8e req-bd3fe464-ec84-4183-8be8-39fbda565915 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received unexpected event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:20:31 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:20:31 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.objects.instance [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'vcpu_model' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:20:31 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503631.5241761, a585b419-b9f5-4bd6-bbc9-cdfc4e732712 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:20:31 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] VM Started (Lifecycle Event)
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaVgHnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:20:31 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:20:31 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:20:31 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6eed09-40af-4ae3-bbef-58462dcfcb67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:20:31 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a433b3-01d2-418c-99af-9a3f113787bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c] added
Jul 28 00:20:31 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:31 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4cca48-d852-4029-aa79-6ad4d304ec4b]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d1af74-1d32-47a8-8938-54e03ceb32d8]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERaVgHnU {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERaVgHnU" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[300494b3-2368-468b-a470-32a7363eadb2]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ERaVgHnU'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8073a5-d9c5-45d4-8557-5fc4898c900b]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[36481ed7-8280-49e3-b451-0dd5baa16dc3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:31 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:31 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:31 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:31 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:31 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:31 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:20:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:31 user nova-compute[70709]: INFO nova.virt.block_device [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Booting with volume 34011d41-b1dd-4b79-837d-3c574de67abd at /dev/vda
Jul 28 00:20:32 user nova-compute[70709]: DEBUG os_brick.utils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[af087d90-7d37-4e49-9eaa-0922547bec76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8fd87d-9c08-4dc9-84a8-4293bb675369]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70543b3-7aa0-4285-a226-9429baa60b23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d32357a-964c-4a4f-8166-c1f561ab4304]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG nova.policy [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e7a795f87ee4e33808e6400d1499b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e4823ac4f42b9aebf3e9de5b745cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:20:32 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[433a6833-7775-4181-a440-51c08a11aa02]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG os_brick.utils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating existing volume attachment record: 65113ac5-039d-415d-adc6-abc87172a25f {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully created port: f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --login" returned: 0 in 1.068s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a8edc2-61cd-4d97-b7b9-13b3ee06c854]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]
Jul 28 00:20:32 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.
Jul 28 00:20:32 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503618.0074012, 2bb828f4-bb7d-4754-bcaa-38f2954b8eee => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:20:33 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] VM Stopped (Lifecycle Event)
Jul 28 00:20:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eb0429-c47e-444c-8bf5-0d9e300de4ee]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG nova.compute.manager [None req-0312f2a5-8c04-4147-9fb3-f747b21c5ecf None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG nova.compute.manager [None req-0312f2a5-8c04-4147-9fb3-f747b21c5ecf None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2cc1d6-9cd7-4b9d-ad6a-d1d957d5c062]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:33 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:33 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:33 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:33 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:33 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:33 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.356s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac501631-7e19-47d7-8f90-74bbdced96c3]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaVgHnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:20:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully created port: 9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.403s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] <== connect_volume: return (2405ms) {'type': 'block', 'scsi_wwn': '26461323732373632', 'path': '/dev/sdd'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461323732373632', 'path': '/dev/sdd'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1488928010',display_name='tempest-ServerActionsTestOtherB-server-1488928010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1488928010',id=3,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnNPKIDRaM81k628x28KRrACS+k9io0IYMr8rKnbfV6R9PEGedJ0uPueig7JixSq/MVd5cruSs8PGo9MLWndddj6j9yk5HzD1hsNyADvhHRJFhgOMMfk3L2UUGGtvzDbA==',key_name='tempest-keypair-458737518',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:19:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8a7ed8f269b4e989727baa24619d774',ramdisk_id='',reservation_id='r-0vm06iql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900188209',owner_user_name='tempest-ServerActionsTestOtherB-1900188209-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc9412c0c5a345399b7cc2ff4540535d',uuid=df55bbd3-31ab-42f8-9a71-4ed8e3c4428c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converting VIF {"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:20:34 user nova-compute[70709]:   <uuid>df55bbd3-31ab-42f8-9a71-4ed8e3c4428c</uuid>
Jul 28 00:20:34 user nova-compute[70709]:   <name>instance-00000003</name>
Jul 28 00:20:34 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:20:34 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:20:34 user nova-compute[70709]:   <metadata>
Jul 28 00:20:34 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:20:34 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:20:34 user nova-compute[70709]:       <nova:name>tempest-ServerActionsTestOtherB-server-1488928010</nova:name>
Jul 28 00:20:34 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:20:31</nova:creationTime>
Jul 28 00:20:34 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:20:34 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:20:34 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:20:34 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:20:34 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:20:34 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:20:34 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:20:34 user nova-compute[70709]:       <nova:owner>
Jul 28 00:20:34 user nova-compute[70709]:         <nova:user uuid="fc9412c0c5a345399b7cc2ff4540535d">tempest-ServerActionsTestOtherB-1900188209-project-member</nova:user>
Jul 28 00:20:34 user nova-compute[70709]:         <nova:project uuid="c8a7ed8f269b4e989727baa24619d774">tempest-ServerActionsTestOtherB-1900188209</nova:project>
Jul 28 00:20:34 user nova-compute[70709]:       </nova:owner>
Jul 28 00:20:34 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:20:34 user nova-compute[70709]:       <nova:ports>
Jul 28 00:20:34 user nova-compute[70709]:         <nova:port uuid="7e92340f-f93d-411f-8e69-2a75164b3679">
Jul 28 00:20:34 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 28 00:20:34 user nova-compute[70709]:         </nova:port>
Jul 28 00:20:34 user nova-compute[70709]:       </nova:ports>
Jul 28 00:20:34 user nova-compute[70709]:     </nova:instance>
Jul 28 00:20:34 user nova-compute[70709]:   </metadata>
Jul 28 00:20:34 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:20:34 user nova-compute[70709]:     <system>
Jul 28 00:20:34 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:20:34 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:20:34 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:20:34 user nova-compute[70709]:       <entry name="serial">df55bbd3-31ab-42f8-9a71-4ed8e3c4428c</entry>
Jul 28 00:20:34 user nova-compute[70709]:       <entry name="uuid">df55bbd3-31ab-42f8-9a71-4ed8e3c4428c</entry>
Jul 28 00:20:34 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:20:34 user nova-compute[70709]:     </system>
Jul 28 00:20:34 user nova-compute[70709]:   </sysinfo>
Jul 28 00:20:34 user nova-compute[70709]:   <os>
Jul 28 00:20:34 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:20:34 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:20:34 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:20:34 user nova-compute[70709]:   </os>
Jul 28 00:20:34 user nova-compute[70709]:   <features>
Jul 28 00:20:34 user nova-compute[70709]:     <acpi/>
Jul 28 00:20:34 user nova-compute[70709]:     <apic/>
Jul 28 00:20:34 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:20:34 user nova-compute[70709]:   </features>
Jul 28 00:20:34 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:20:34 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:20:34 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:20:34 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:20:34 user nova-compute[70709]:   </clock>
Jul 28 00:20:34 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:20:34 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:20:34 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:20:34 user nova-compute[70709]:   </cpu>
Jul 28 00:20:34 user nova-compute[70709]:   <devices>
Jul 28 00:20:34 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:20:34 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:20:34 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk"/>
Jul 28 00:20:34 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:20:34 user nova-compute[70709]:     </disk>
Jul 28 00:20:34 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:20:34 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:20:34 user nova-compute[70709]:       <source dev="/dev/sdd"/>
Jul 28 00:20:34 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:20:34 user nova-compute[70709]:       <serial>86b782c7-df0d-4e2a-8b05-6dba869dde7c</serial>
Jul 28 00:20:34 user nova-compute[70709]:     </disk>
Jul 28 00:20:34 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:20:34 user nova-compute[70709]:       <mac address="fa:16:3e:58:0f:bc"/>
Jul 28 00:20:34 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:20:34 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:20:34 user nova-compute[70709]:       <target dev="tap7e92340f-f9"/>
Jul 28 00:20:34 user nova-compute[70709]:     </interface>
Jul 28 00:20:34 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:20:34 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/console.log" append="off"/>
Jul 28 00:20:34 user nova-compute[70709]:     </serial>
Jul 28 00:20:34 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:20:34 user nova-compute[70709]:     <video>
Jul 28 00:20:34 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:20:34 user nova-compute[70709]:     </video>
Jul 28 00:20:34 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:20:34 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:20:34 user nova-compute[70709]:     </rng>
Jul 28 00:20:34 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:20:34 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:20:34 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:20:34 user nova-compute[70709]:     </memballoon>
Jul 28 00:20:34 user nova-compute[70709]:   </devices>
Jul 28 00:20:34 user nova-compute[70709]: </domain>
Jul 28 00:20:34 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1488928010',display_name='tempest-ServerActionsTestOtherB-server-1488928010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1488928010',id=3,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnNPKIDRaM81k628x28KRrACS+k9io0IYMr8rKnbfV6R9PEGedJ0uPueig7JixSq/MVd5cruSs8PGo9MLWndddj6j9yk5HzD1hsNyADvhHRJFhgOMMfk3L2UUGGtvzDbA==',key_name='tempest-keypair-458737518',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:19:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8a7ed8f269b4e989727baa24619d774',ramdisk_id='',reservation_id='r-0vm06iql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900188209',owner_user_name='tempest-ServerActionsTestOtherB-1900188209-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc9412c0c5a345399b7cc2ff4540535d',uuid=df55bbd3-31ab-42f8-9a71-4ed8e3c4428c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converting VIF {"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG os_vif [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e92340f-f9, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e92340f-f9, col_values=(('external_ids', {'iface-id': '7e92340f-f93d-411f-8e69-2a75164b3679', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:0f:bc', 'vm-uuid': 'df55bbd3-31ab-42f8-9a71-4ed8e3c4428c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully created port: ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:20:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:34 user nova-compute[70709]: INFO os_vif [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9')
Jul 28 00:20:34 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully created port: 7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:20:35 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503620.1021664, df55bbd3-31ab-42f8-9a71-4ed8e3c4428c => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:20:35 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] VM Stopped (Lifecycle Event)
Jul 28 00:20:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-153a1773-4095-4ae4-a044-472b92eae194 None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:20:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:35 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully created port: c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:20:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-548588a8-e37d-4b32-9ef1-988845d2f157 req-4b856ad6-960b-46a2-9033-093f31e69054 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-548588a8-e37d-4b32-9ef1-988845d2f157 req-4b856ad6-960b-46a2-9033-093f31e69054 service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-548588a8-e37d-4b32-9ef1-988845d2f157 req-4b856ad6-960b-46a2-9033-093f31e69054 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-548588a8-e37d-4b32-9ef1-988845d2f157 req-4b856ad6-960b-46a2-9033-093f31e69054 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-548588a8-e37d-4b32-9ef1-988845d2f157 req-4b856ad6-960b-46a2-9033-093f31e69054 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:36 user nova-compute[70709]: WARNING nova.compute.manager [req-548588a8-e37d-4b32-9ef1-988845d2f157 req-4b856ad6-960b-46a2-9033-093f31e69054 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received unexpected event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with vm_state resized and task_state resize_reverting.
Jul 28 00:20:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully updated port: f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-9e5b603f-1f7c-4a51-9e09-3b910f0a0332 req-26bfbe98-7c2f-4259-94e8-4161fbabea51 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-changed-f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-9e5b603f-1f7c-4a51-9e09-3b910f0a0332 req-26bfbe98-7c2f-4259-94e8-4161fbabea51 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing instance network info cache due to event network-changed-f016184b-b548-4b42-ba6d-34dfa078dc0d. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9e5b603f-1f7c-4a51-9e09-3b910f0a0332 req-26bfbe98-7c2f-4259-94e8-4161fbabea51 service nova] Acquiring lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9e5b603f-1f7c-4a51-9e09-3b910f0a0332 req-26bfbe98-7c2f-4259-94e8-4161fbabea51 service nova] Acquired lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:36 user nova-compute[70709]: DEBUG nova.network.neutron [req-9e5b603f-1f7c-4a51-9e09-3b910f0a0332 req-26bfbe98-7c2f-4259-94e8-4161fbabea51 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing network info cache for port f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:20:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-9e5b603f-1f7c-4a51-9e09-3b910f0a0332 req-26bfbe98-7c2f-4259-94e8-4161fbabea51 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:20:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-9e5b603f-1f7c-4a51-9e09-3b910f0a0332 req-26bfbe98-7c2f-4259-94e8-4161fbabea51 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9e5b603f-1f7c-4a51-9e09-3b910f0a0332 req-26bfbe98-7c2f-4259-94e8-4161fbabea51 service nova] Releasing lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:37 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully updated port: 013036a7-b111-4260-b252-7607b25c720a {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-73eabbbb-6fa6-41c8-a5a6-80e81fb8eaa5 req-22953037-4f43-42de-a152-0756a6c0803f service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-73eabbbb-6fa6-41c8-a5a6-80e81fb8eaa5 req-22953037-4f43-42de-a152-0756a6c0803f service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-73eabbbb-6fa6-41c8-a5a6-80e81fb8eaa5 req-22953037-4f43-42de-a152-0756a6c0803f service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-73eabbbb-6fa6-41c8-a5a6-80e81fb8eaa5 req-22953037-4f43-42de-a152-0756a6c0803f service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-73eabbbb-6fa6-41c8-a5a6-80e81fb8eaa5 req-22953037-4f43-42de-a152-0756a6c0803f service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:20:38 user nova-compute[70709]: WARNING nova.compute.manager [req-73eabbbb-6fa6-41c8-a5a6-80e81fb8eaa5 req-22953037-4f43-42de-a152-0756a6c0803f service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received unexpected event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with vm_state resized and task_state resize_reverting.
Jul 28 00:20:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503638.386599, df55bbd3-31ab-42f8-9a71-4ed8e3c4428c => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:20:38 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] VM Resumed (Lifecycle Event)
Jul 28 00:20:38 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance running successfully.
Jul 28 00:20:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] finish_revert_migration finished successfully. {{(pid=70709) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:20:38 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 28 00:20:38 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503638.3878489, df55bbd3-31ab-42f8-9a71-4ed8e3c4428c => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:20:38 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] VM Started (Lifecycle Event)
Jul 28 00:20:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBFbGOCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:20:38 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:20:38 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:20:38 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee51ddd-0308-42cd-8e12-452975dd4881]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:20:38 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:38 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea797271-834e-4ffd-84b3-2902aff97a1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438] added
Jul 28 00:20:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[323c3aa9-d3f3-4dc3-9fa0-89945f6d7cca]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d08e7df-d735-47bd-95e3-7c6d51ed1e32]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBFbGOCZ {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBFbGOCZ" returned: 0 in 0.038s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[40590f33-09c9-4b98-b242-51aba3017b27]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EBFbGOCZ'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b25f213-4e00-4817-9ff0-a7f9bdc39bb4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:38 user nova-compute[70709]: INFO nova.compute.manager [None req-27bfdabf-9d32-4968-a920-591fa14bb45f tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating instance to original state: 'active'
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[51193e87-5aea-4aec-aae4-fccbac7a4c8e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:38 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:38 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:38 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:38 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:38 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:38 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc00806-d16b-47c2-b2a7-2c6ff503f9d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438, portal: 172.16.0.220,3260]
Jul 28 00:20:38 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438, portal: 172.16.0.220,3260] successful.
Jul 28 00:20:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79cc1a7-e536-4241-bd41-ffecbc136255]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3c1973-f01c-45ac-af7a-f7722681bafb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:39 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:39 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:39 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:39 user nova-compute[70709]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 (non-flash)
Jul 28 00:20:39 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:39 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:39 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:39 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:39 user nova-compute[70709]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 (non-flash)
Jul 28 00:20:39 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.538s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG nova.compute.manager [req-9ef01241-4da4-4cf4-b259-cfbb8c0522d7 req-0266dfd5-bbce-424f-9681-f95070b2cce8 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-changed-013036a7-b111-4260-b252-7607b25c720a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG nova.compute.manager [req-9ef01241-4da4-4cf4-b259-cfbb8c0522d7 req-0266dfd5-bbce-424f-9681-f95070b2cce8 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing instance network info cache due to event network-changed-013036a7-b111-4260-b252-7607b25c720a. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9ef01241-4da4-4cf4-b259-cfbb8c0522d7 req-0266dfd5-bbce-424f-9681-f95070b2cce8 service nova] Acquiring lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9ef01241-4da4-4cf4-b259-cfbb8c0522d7 req-0266dfd5-bbce-424f-9681-f95070b2cce8 service nova] Acquired lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG nova.network.neutron [req-9ef01241-4da4-4cf4-b259-cfbb8c0522d7 req-0266dfd5-bbce-424f-9681-f95070b2cce8 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing network info cache for port 013036a7-b111-4260-b252-7607b25c720a {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.034s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[88667de5-b08e-4c15-b7eb-cb6a4a17640b]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBFbGOCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG nova.network.neutron [req-9ef01241-4da4-4cf4-b259-cfbb8c0522d7 req-0266dfd5-bbce-424f-9681-f95070b2cce8 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG nova.network.neutron [req-9ef01241-4da4-4cf4-b259-cfbb8c0522d7 req-0266dfd5-bbce-424f-9681-f95070b2cce8 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9ef01241-4da4-4cf4-b259-cfbb8c0522d7 req-0266dfd5-bbce-424f-9681-f95070b2cce8 service nova] Releasing lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:40 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully updated port: a7690ded-3dff-429d-8c20-45ee6ee8f662 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:20:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.641s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:20:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] <== connect_volume: return (1644ms) {'type': 'block', 'scsi_wwn': '23639336563373134', 'path': '/dev/sdf'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:20:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639336563373134', 'path': '/dev/sdf'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:20:40 user nova-compute[70709]: DEBUG nova.objects.instance [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lazy-loading 'flavor' on Instance uuid 8168aa39-afce-4c9e-ba76-78a760767357 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:20:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:20:40 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:20:40 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:20:40 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:20:40 user nova-compute[70709]:   <serial>7203354c-68f0-40c4-8f8c-254dd1622438</serial>
Jul 28 00:20:40 user nova-compute[70709]: </disk>
Jul 28 00:20:40 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:20:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:20:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:20:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] No VIF found with MAC fa:16:3e:41:8c:f9, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:20:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-86c1fce9-8e8e-45d8-ba3f-6ce09061ab9a tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.611s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-bc831c8f-e74f-432b-abf5-8c98388baa0f req-defc2686-cb86-497f-bd2b-409187d97599 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-changed-a7690ded-3dff-429d-8c20-45ee6ee8f662 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-bc831c8f-e74f-432b-abf5-8c98388baa0f req-defc2686-cb86-497f-bd2b-409187d97599 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing instance network info cache due to event network-changed-a7690ded-3dff-429d-8c20-45ee6ee8f662. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:20:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bc831c8f-e74f-432b-abf5-8c98388baa0f req-defc2686-cb86-497f-bd2b-409187d97599 service nova] Acquiring lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bc831c8f-e74f-432b-abf5-8c98388baa0f req-defc2686-cb86-497f-bd2b-409187d97599 service nova] Acquired lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-bc831c8f-e74f-432b-abf5-8c98388baa0f req-defc2686-cb86-497f-bd2b-409187d97599 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing network info cache for port a7690ded-3dff-429d-8c20-45ee6ee8f662 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:20:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-bc831c8f-e74f-432b-abf5-8c98388baa0f req-defc2686-cb86-497f-bd2b-409187d97599 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:20:41 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully updated port: 9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:20:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-bc831c8f-e74f-432b-abf5-8c98388baa0f req-defc2686-cb86-497f-bd2b-409187d97599 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bc831c8f-e74f-432b-abf5-8c98388baa0f req-defc2686-cb86-497f-bd2b-409187d97599 service nova] Releasing lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:42 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully updated port: ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:20:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "8168aa39-afce-4c9e-ba76-78a760767357" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:42 user nova-compute[70709]: INFO nova.compute.manager [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Detaching volume 7203354c-68f0-40c4-8f8c-254dd1622438
Jul 28 00:20:42 user nova-compute[70709]: INFO nova.virt.block_device [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Attempting to driver detach volume 7203354c-68f0-40c4-8f8c-254dd1622438 from mountpoint /dev/vdb
Jul 28 00:20:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Attempting to detach device vdb from instance 8168aa39-afce-4c9e-ba76-78a760767357 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:20:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:20:42 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:20:42 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:20:42 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:20:42 user nova-compute[70709]:   <serial>7203354c-68f0-40c4-8f8c-254dd1622438</serial>
Jul 28 00:20:42 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:20:42 user nova-compute[70709]: </disk>
Jul 28 00:20:42 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:20:42 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Successfully detached device vdb from instance 8168aa39-afce-4c9e-ba76-78a760767357 from the persistent domain config.
Jul 28 00:20:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8168aa39-afce-4c9e-ba76-78a760767357 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:20:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:20:42 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:20:42 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:20:42 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:20:42 user nova-compute[70709]:   <serial>7203354c-68f0-40c4-8f8c-254dd1622438</serial>
Jul 28 00:20:42 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:20:42 user nova-compute[70709]: </disk>
Jul 28 00:20:42 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully updated port: 7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-changed-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing instance network info cache due to event network-changed-9d835d57-22e1-4a6a-bccd-97bcd8607cb4. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] Acquiring lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] Acquired lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.network.neutron [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing network info cache for port 9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.network.neutron [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503643.4192774, 8168aa39-afce-4c9e-ba76-78a760767357 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8168aa39-afce-4c9e-ba76-78a760767357 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:20:43 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Successfully detached device vdb from instance 8168aa39-afce-4c9e-ba76-78a760767357 from the live domain config.
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBFbGOCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:20:43 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6297df30-d50a-4837-b5b1-eea5b524fea8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:20:43 user nova-compute[70709]: No targets found.
Jul 28 00:20:43 user nova-compute[70709]: iSNS:
Jul 28 00:20:43 user nova-compute[70709]: No targets found.
Jul 28 00:20:43 user nova-compute[70709]: STATIC:
Jul 28 00:20:43 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:20:43 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:43 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:43 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c
Jul 28 00:20:43 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:43 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:43 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:20:43 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:43 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:43 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0
Jul 28 00:20:43 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:43 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:43 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438
Jul 28 00:20:43 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:20:43 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:20:43 user nova-compute[70709]: FIRMWARE:
Jul 28 00:20:43 user nova-compute[70709]: No targets found.
Jul 28 00:20:43 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:20:43 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:20:43 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a41a21-1a81-4a35-b874-74d6abbb491c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2379ba-166b-4f65-aad6-c1e77f1b817a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:43 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:43 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:43 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:43 user nova-compute[70709]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 (non-flash)
Jul 28 00:20:43 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:20:43 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:20:43 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:20:43 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:20:43 user nova-compute[70709]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 (non-flash)
Jul 28 00:20:43 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b901916c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438'): ({'sdf'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Removing single pathed devices sdf {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.network.neutron [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41317a0-e501-4b07-b86d-17817a53e496]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] Releasing lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-changed-ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing instance network info cache due to event network-changed-ff930c20-069f-496d-9883-84907c2eb856. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] Acquiring lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] Acquired lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.network.neutron [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing network info cache for port ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e044046-821c-4174-9ad6-657131456f54]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Flushing IO for device /dev/sdf {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e549fe34-85ed-46de-89b3-134403af405f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea20a48-29a3-4afc-bd68-099564170718]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.network.neutron [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d9ad6c-ce11-4a7c-ab17-0c6f513b6a8f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb8843c-450a-45c7-917b-ca66e543a4da]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438, portal: 172.16.0.220,3260]
Jul 28 00:20:43 user nova-compute[70709]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438, portal: 172.16.0.220,3260] successful.
Jul 28 00:20:43 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7203354c-68f0-40c4-8f8c-254dd1622438 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[302a7796-119c-4810-855a-0eab836cc1db]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] <== disconnect_volume: return (403ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.network.neutron [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] Releasing lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-changed-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing instance network info cache due to event network-changed-7a7bdc1c-851d-431e-9ca0-f2477e1caf39. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] Acquiring lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] Acquired lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:43 user nova-compute[70709]: DEBUG nova.network.neutron [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing network info cache for port 7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:20:44 user nova-compute[70709]: DEBUG nova.network.neutron [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:20:44 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Successfully updated port: c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:20:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:44 user nova-compute[70709]: DEBUG nova.network.neutron [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d1b37ee8-4000-42a2-a185-c908306d20f3 req-cf2cbce0-f384-4804-9632-c43b9a4ad20e service nova] Releasing lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquired lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:44 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:20:44 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:20:44 user nova-compute[70709]: DEBUG nova.objects.instance [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lazy-loading 'flavor' on Instance uuid 8168aa39-afce-4c9e-ba76-78a760767357 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:20:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7c17127f-db7a-45fb-a912-b08f850cbea1 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.073s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:20:44 user nova-compute[70709]: INFO nova.virt.block_device [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Booting with volume 16438393-b31a-4090-be62-9f763da2c251 at /dev/vdb
Jul 28 00:20:45 user nova-compute[70709]: DEBUG os_brick.utils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d8ed64-efb7-48ee-a325-6c5084e78eab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8981ac23-dbef-48a7-a252-222754fc73f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8648bd-d6d7-4fce-80b3-47404c840715]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f434b0-5095-48ab-8296-812a380f3623]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:20:45 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d143ef-2c45-494d-8a50-29703dd95821]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG os_brick.utils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating existing volume attachment record: ed1679f0-3d38-444d-afe4-1a3a106d5bc1 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-f4c67f9d-d4b9-436d-840a-3284c6635ae6 req-47a8e6d1-086a-4f7b-948b-0bc44d1a6081 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-changed-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-f4c67f9d-d4b9-436d-840a-3284c6635ae6 req-47a8e6d1-086a-4f7b-948b-0bc44d1a6081 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing instance network info cache due to event network-changed-c4d13f1c-c3f9-4c10-a54f-03a180c736a8. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:20:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f4c67f9d-d4b9-436d-840a-3284c6635ae6 req-47a8e6d1-086a-4f7b-948b-0bc44d1a6081 service nova] Acquiring lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:20:46 user nova-compute[70709]: DEBUG nova.network.neutron [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating instance_info_cache with network_info: [{"id": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "address": "fa:16:3e:a6:f1:19", "network": {"id": "2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1149022988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf016184b-b5", "ovs_interfaceid": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Releasing lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Instance network_info: |[{"id": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "address": "fa:16:3e:a6:f1:19", "network": {"id": "2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1149022988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf016184b-b5", "ovs_interfaceid": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:20:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f4c67f9d-d4b9-436d-840a-3284c6635ae6 req-47a8e6d1-086a-4f7b-948b-0bc44d1a6081 service nova] Acquired lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:20:46 user nova-compute[70709]: DEBUG nova.network.neutron [req-f4c67f9d-d4b9-436d-840a-3284c6635ae6 req-47a8e6d1-086a-4f7b-948b-0bc44d1a6081 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing network info cache for port c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:20:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:47 user nova-compute[70709]: DEBUG nova.network.neutron [req-f4c67f9d-d4b9-436d-840a-3284c6635ae6 req-47a8e6d1-086a-4f7b-948b-0bc44d1a6081 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updated VIF entry in instance network info cache for port c4d13f1c-c3f9-4c10-a54f-03a180c736a8. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:20:47 user nova-compute[70709]: DEBUG nova.network.neutron [req-f4c67f9d-d4b9-436d-840a-3284c6635ae6 req-47a8e6d1-086a-4f7b-948b-0bc44d1a6081 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating instance_info_cache with network_info: [{"id": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "address": "fa:16:3e:a6:f1:19", "network": {"id": "2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1149022988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf016184b-b5", "ovs_interfaceid": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:20:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f4c67f9d-d4b9-436d-840a-3284c6635ae6 req-47a8e6d1-086a-4f7b-948b-0bc44d1a6081 service nova] Releasing lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:20:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:54 user nova-compute[70709]: INFO nova.virt.block_device [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Booting with volume d456834c-e70e-4daf-be6c-6e4d1870048d at /dev/vdc
Jul 28 00:20:54 user nova-compute[70709]: DEBUG os_brick.utils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[52288f74-a178-44b2-a977-366543e9c01e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9efa4d1-dab3-4f7d-b57f-b243c93cb7cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb43a53-7270-473e-b824-34a9931e2610]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b7fcac-1196-41f0-8948-3d1e45c5264a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:20:54 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:20:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7ee295-04cd-4e9a-8c7f-7c6a2c56f92d]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG os_brick.utils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:20:54 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating existing volume attachment record: af9b046a-4c7b-427e-b5d2-21283dcd6f85 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:20:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:20:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:20:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:20:59 user nova-compute[70709]: INFO nova.compute.manager [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Detaching volume 824b06e1-befc-4367-baec-2e5c531a438c
Jul 28 00:20:59 user nova-compute[70709]: INFO nova.virt.block_device [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Attempting to driver detach volume 824b06e1-befc-4367-baec-2e5c531a438c from mountpoint /dev/vdb
Jul 28 00:21:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Attempting to detach device vdb from instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:21:00 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:21:00 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:21:00 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:21:00 user nova-compute[70709]:   <serial>824b06e1-befc-4367-baec-2e5c531a438c</serial>
Jul 28 00:21:00 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:21:00 user nova-compute[70709]: </disk>
Jul 28 00:21:00 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:21:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Successfully detached device vdb from instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 from the persistent domain config.
Jul 28 00:21:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:21:00 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:21:00 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:21:00 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:21:00 user nova-compute[70709]:   <serial>824b06e1-befc-4367-baec-2e5c531a438c</serial>
Jul 28 00:21:00 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:21:00 user nova-compute[70709]: </disk>
Jul 28 00:21:00 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-af71d749-3214-49b9-b159-b34fba345ba1 req-e0229c0a-bd2a-4132-803d-eb725cc1559b service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-changed-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-af71d749-3214-49b9-b159-b34fba345ba1 req-e0229c0a-bd2a-4132-803d-eb725cc1559b service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Refreshing instance network info cache due to event network-changed-726f9120-5db5-4e03-aa01-07c310849ae4. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-af71d749-3214-49b9-b159-b34fba345ba1 req-e0229c0a-bd2a-4132-803d-eb725cc1559b service nova] Acquiring lock "refresh_cache-c6297718-d595-4657-aa32-aa75bffdf955" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-af71d749-3214-49b9-b159-b34fba345ba1 req-e0229c0a-bd2a-4132-803d-eb725cc1559b service nova] Acquired lock "refresh_cache-c6297718-d595-4657-aa32-aa75bffdf955" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG nova.network.neutron [req-af71d749-3214-49b9-b159-b34fba345ba1 req-e0229c0a-bd2a-4132-803d-eb725cc1559b service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Refreshing network info cache for port 726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503660.6373022, a585b419-b9f5-4bd6-bbc9-cdfc4e732712 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:21:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Successfully detached device vdb from instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 from the live domain config.
Jul 28 00:21:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaPrmsKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:21:00 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5527a9-b101-4a44-bc22-8163a86c3eeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:21:00 user nova-compute[70709]: No targets found.
Jul 28 00:21:00 user nova-compute[70709]: iSNS:
Jul 28 00:21:00 user nova-compute[70709]: No targets found.
Jul 28 00:21:00 user nova-compute[70709]: STATIC:
Jul 28 00:21:00 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:21:00 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:21:00 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:21:00 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c
Jul 28 00:21:00 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:21:00 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:21:00 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:21:00 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:21:00 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:21:00 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0
Jul 28 00:21:00 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:21:00 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:21:00 user nova-compute[70709]: FIRMWARE:
Jul 28 00:21:00 user nova-compute[70709]: No targets found.
Jul 28 00:21:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:21:00 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:21:00 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[db05e3bb-c1c7-4369-b07b-cf635048842c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[11da4421-a5f4-45c1-aaba-47e98491e25a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:00 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:21:00 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:00 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:00 user nova-compute[70709]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c (non-flash)
Jul 28 00:21:00 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:00 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90396b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c'): ({'sde'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Removing single pathed devices sde {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c9fba0-7eea-4bfc-92ae-964bc233cc05]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2aa90c-9e46-4c95-9a28-4a46b845d441]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Flushing IO for device /dev/sde {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[25298b57-c865-49c1-9b5d-63ecaa039680]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86a931e-54c0-4e3f-88ad-3b5683835915]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec250884-eb8e-4c11-8de5-897374df6c0f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0365093f-6d47-45fe-932c-0de5b2545f82]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c, portal: 172.16.0.220,3260]
Jul 28 00:21:00 user nova-compute[70709]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c, portal: 172.16.0.220,3260] successful.
Jul 28 00:21:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824b06e1-befc-4367-baec-2e5c531a438c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d64d03-dfa2-4094-bdb8-735dabd89025]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] <== disconnect_volume: return (333ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:21:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:21:01 user nova-compute[70709]: DEBUG nova.network.neutron [req-af71d749-3214-49b9-b159-b34fba345ba1 req-e0229c0a-bd2a-4132-803d-eb725cc1559b service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Updated VIF entry in instance network info cache for port 726f9120-5db5-4e03-aa01-07c310849ae4. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:21:01 user nova-compute[70709]: DEBUG nova.network.neutron [req-af71d749-3214-49b9-b159-b34fba345ba1 req-e0229c0a-bd2a-4132-803d-eb725cc1559b service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Updating instance_info_cache with network_info: [{"id": "726f9120-5db5-4e03-aa01-07c310849ae4", "address": "fa:16:3e:85:c0:80", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f9120-5d", "ovs_interfaceid": "726f9120-5db5-4e03-aa01-07c310849ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:21:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-af71d749-3214-49b9-b159-b34fba345ba1 req-e0229c0a-bd2a-4132-803d-eb725cc1559b service nova] Releasing lock "refresh_cache-c6297718-d595-4657-aa32-aa75bffdf955" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:21:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:21:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Creating image(s)
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Ensure instance console log exists: /opt/stack/data/nova/instances/3b071a76-32ed-4d72-a3d5-5e4b42bc689c/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Start _get_guest_xml network_info=[{"id": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "address": "fa:16:3e:a6:f1:19", "network": {"id": "2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1149022988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf016184b-b5", "ovs_interfaceid": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '65113ac5-039d-415d-adc6-abc87172a25f', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPuvQJOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b071a76-32ed-4d72-a3d5-5e4b42bc689c', 'attached_at': '', 'detached_at': '', 'volume_id': '34011d41-b1dd-4b79-837d-3c574de67abd', 'serial': '34011d41-b1dd-4b79-837d-3c574de67abd'}, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': 'ed1679f0-3d38-444d-afe4-1a3a106d5bc1', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBNMKlaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b071a76-32ed-4d72-a3d5-5e4b42bc689c', 'attached_at': '', 'detached_at': '', 'volume_id': '16438393-b31a-4090-be62-9f763da2c251', 'serial': '16438393-b31a-4090-be62-9f763da2c251'}, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': 'af9b046a-4c7b-427e-b5d2-21283dcd6f85', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CaTuqxSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b071a76-32ed-4d72-a3d5-5e4b42bc689c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd456834c-e70e-4daf-be6c-6e4d1870048d', 'serial': 'd456834c-e70e-4daf-be6c-6e4d1870048d'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:21:02 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:21:02 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPuvQJOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:21:02 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:02 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:02 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:21:02 user nova-compute[70709]: DEBUG nova.objects.instance [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'flavor' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2785df5-74be-4ed2-9873-be80b62ffe75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:21:02 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dfeb17-df52-4996-a615-aaee1128f232]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd] added
Jul 28 00:21:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-164abd55-dec6-4d57-bc8a-3767cc7ca24b tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.046s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[16111a17-d856-4b37-9c23-7b5312726b79]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[13244d39-1efd-4dc8-bcf2-34b753620bc3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPuvQJOa {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPuvQJOa" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f616f8e-2f10-4345-af4a-e536ca5f0b1f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yPuvQJOa'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[552e4820-7a73-408a-98e1-724adb2295d1]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[73226fc5-fd08-4a13-a0f8-96a1f8b00d1c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:02 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:02 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:02 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:02 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2ffc51-8d1b-486f-b5e0-c435d39b022a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd, portal: 172.16.0.220,3260]
Jul 28 00:21:02 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd, portal: 172.16.0.220,3260] successful.
Jul 28 00:21:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.159s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4676a08f-6ba7-4a62-8954-5a21129ac3a7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a586b975-3395-47c2-933e-e760743b53ad]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:03 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:03 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:03 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:03 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:03 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:03 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.469s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[861885a9-9024-4115-9368-63c2aa14ef11]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPuvQJOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.502s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] <== connect_volume: return (1503ms) {'type': 'block', 'scsi_wwn': '26531393536626165', 'path': '/dev/sde'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531393536626165', 'path': '/dev/sde'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBNMKlaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:21:04 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:04 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:04 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[171dba7b-43ba-415e-9b00-fd8726ce3608]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:21:04 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbafe678-78b7-4b1f-bd39-a8acfc6c6e23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251] added
Jul 28 00:21:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[971cb48b-4bf4-4027-8831-6fd2aa8b3115]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d7b73f-7e7a-4cce-866e-13041fbe6fdb]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBNMKlaC {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBNMKlaC" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e89681d-790f-4f8b-9193-75b44bea290f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XBNMKlaC'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de13a14-599a-4dda-b186-9fec1a98cb33]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94c7b05-c595-4227-8024-b31f916e89b6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[954c8a8f-c59a-4b0a-8502-5ee7fb34ea97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251, portal: 172.16.0.220,3260]
Jul 28 00:21:04 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251, portal: 172.16.0.220,3260] successful.
Jul 28 00:21:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a76d1c-26c8-49d1-b3cc-08319a836ef1]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0772e0b9-3e37-4dc8-98c2-8b72bb495a6b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:04 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[06030f51-730e-4f7f-a35d-6f900e831063]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:21:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBNMKlaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23338366239303239', 'path': '/dev/sdf'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338366239303239', 'path': '/dev/sdf'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CaTuqxSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:21:05 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:05 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:05 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb12b7-a321-4473-a76f-db1fd4d2108f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:21:05 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbe2bd2-08be-4149-bf5a-196abfcf11d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d] added
Jul 28 00:21:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0090c07a-477d-4930-9d57-daa25b79fb77]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[451745c7-5e71-4c4b-b1bc-7e25918d67d0]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CaTuqxSz {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CaTuqxSz" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab9344c-7778-4564-86b3-9c126ae7cb6b]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CaTuqxSz'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f2e877-24b3-4c14-a1d3-4c8695a78eae]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1782ca-8368-40e0-b490-c955949f4ba8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:05 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:05 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:05 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:05 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:05 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:05 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:05 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:05 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b0cb5a-daaa-4dba-a2d6-b029ddf48825]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d, portal: 172.16.0.220,3260]
Jul 28 00:21:05 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d, portal: 172.16.0.220,3260] successful.
Jul 28 00:21:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a539969-5cc0-4f34-b66a-51c433a09398]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06deb82-a79f-4094-90c8-95bd6bc1e2da]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:06 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:06 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:06 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:06 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:06 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:06 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:06 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:06 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:06 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:06 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:06 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:06 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d6235-984c-4c6c-9181-214aaf04573d]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CaTuqxSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "75132de4-0252-4bee-bb51-24602cc586ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:21:06 user nova-compute[70709]: INFO nova.compute.claims [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Claim successful on node user
Jul 28 00:21:06 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:21:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:21:06 user nova-compute[70709]: DEBUG nova.policy [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8557f7232a94f76982b8840c534a6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05b559855734f9e9b221ec954881ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26464616232313734', 'path': '/dev/sdg'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464616232313734', 'path': '/dev/sdg'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:21:07 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Creating image(s)
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "/opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "/opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "/opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "address": "fa:16:3e:a6:f1:19", "network": {"id": "2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1149022988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf016184b-b5", "ovs_interfaceid": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "address": "fa:16:3e:a6:f1:19", "network": {"id": "2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1149022988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf016184b-b5", "ovs_interfaceid": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f1:19,bridge_name='br-int',has_traffic_filtering=True,id=f016184b-b548-4b42-ba6d-34dfa078dc0d,network=Network(2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf016184b-b5') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=013036a7-b111-4260-b252-7607b25c720a,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap013036a7-b1') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:90:0c,bridge_name='br-int',has_traffic_filtering=True,id=a7690ded-3dff-429d-8c20-45ee6ee8f662,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa7690ded-3d') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=9d835d57-22e1-4a6a-bccd-97bcd8607cb4,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d835d57-22') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=ff930c20-069f-496d-9883-84907c2eb856,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff930c20-06') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:9b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7a7bdc1c-851d-431e-9ca0-f2477e1caf39,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7bdc1c-85') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:29:e7,bridge_name='br-int',has_traffic_filtering=True,id=c4d13f1c-c3f9-4c10-a54f-03a180c736a8,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d13f1c-c3') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.objects.instance [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b071a76-32ed-4d72-a3d5-5e4b42bc689c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:21:07 user nova-compute[70709]:   <uuid>3b071a76-32ed-4d72-a3d5-5e4b42bc689c</uuid>
Jul 28 00:21:07 user nova-compute[70709]:   <name>instance-00000012</name>
Jul 28 00:21:07 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:21:07 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:21:07 user nova-compute[70709]:   <metadata>
Jul 28 00:21:07 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:21:07 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:21:07 user nova-compute[70709]:       <nova:name>tempest-device-tagging-server-456267461</nova:name>
Jul 28 00:21:07 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:21:02</nova:creationTime>
Jul 28 00:21:07 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:21:07 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:21:07 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:21:07 user nova-compute[70709]:       <nova:owner>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:user uuid="3e7a795f87ee4e33808e6400d1499b58">tempest-TaggedBootDevicesTest_v242-1475790778-project-member</nova:user>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:project uuid="f76e4823ac4f42b9aebf3e9de5b745cf">tempest-TaggedBootDevicesTest_v242-1475790778</nova:project>
Jul 28 00:21:07 user nova-compute[70709]:       </nova:owner>
Jul 28 00:21:07 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:21:07 user nova-compute[70709]:       <nova:ports>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:port uuid="f016184b-b548-4b42-ba6d-34dfa078dc0d">
Jul 28 00:21:07 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 28 00:21:07 user nova-compute[70709]:         </nova:port>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:port uuid="013036a7-b111-4260-b252-7607b25c720a">
Jul 28 00:21:07 user nova-compute[70709]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Jul 28 00:21:07 user nova-compute[70709]:         </nova:port>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:port uuid="a7690ded-3dff-429d-8c20-45ee6ee8f662">
Jul 28 00:21:07 user nova-compute[70709]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Jul 28 00:21:07 user nova-compute[70709]:         </nova:port>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:port uuid="9d835d57-22e1-4a6a-bccd-97bcd8607cb4">
Jul 28 00:21:07 user nova-compute[70709]:           <nova:ip type="fixed" address="10.1.1.153" ipVersion="4"/>
Jul 28 00:21:07 user nova-compute[70709]:         </nova:port>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:port uuid="ff930c20-069f-496d-9883-84907c2eb856">
Jul 28 00:21:07 user nova-compute[70709]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
Jul 28 00:21:07 user nova-compute[70709]:         </nova:port>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:port uuid="7a7bdc1c-851d-431e-9ca0-f2477e1caf39">
Jul 28 00:21:07 user nova-compute[70709]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 28 00:21:07 user nova-compute[70709]:         </nova:port>
Jul 28 00:21:07 user nova-compute[70709]:         <nova:port uuid="c4d13f1c-c3f9-4c10-a54f-03a180c736a8">
Jul 28 00:21:07 user nova-compute[70709]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 28 00:21:07 user nova-compute[70709]:         </nova:port>
Jul 28 00:21:07 user nova-compute[70709]:       </nova:ports>
Jul 28 00:21:07 user nova-compute[70709]:     </nova:instance>
Jul 28 00:21:07 user nova-compute[70709]:   </metadata>
Jul 28 00:21:07 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:21:07 user nova-compute[70709]:     <system>
Jul 28 00:21:07 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:21:07 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:21:07 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:21:07 user nova-compute[70709]:       <entry name="serial">3b071a76-32ed-4d72-a3d5-5e4b42bc689c</entry>
Jul 28 00:21:07 user nova-compute[70709]:       <entry name="uuid">3b071a76-32ed-4d72-a3d5-5e4b42bc689c</entry>
Jul 28 00:21:07 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:21:07 user nova-compute[70709]:     </system>
Jul 28 00:21:07 user nova-compute[70709]:   </sysinfo>
Jul 28 00:21:07 user nova-compute[70709]:   <os>
Jul 28 00:21:07 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:21:07 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:21:07 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:21:07 user nova-compute[70709]:   </os>
Jul 28 00:21:07 user nova-compute[70709]:   <features>
Jul 28 00:21:07 user nova-compute[70709]:     <acpi/>
Jul 28 00:21:07 user nova-compute[70709]:     <apic/>
Jul 28 00:21:07 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:21:07 user nova-compute[70709]:   </features>
Jul 28 00:21:07 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:21:07 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:21:07 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:21:07 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:21:07 user nova-compute[70709]:   </clock>
Jul 28 00:21:07 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:21:07 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:21:07 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:21:07 user nova-compute[70709]:   </cpu>
Jul 28 00:21:07 user nova-compute[70709]:   <devices>
Jul 28 00:21:07 user nova-compute[70709]:     <disk type="file" device="cdrom">
Jul 28 00:21:07 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none"/>
Jul 28 00:21:07 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/3b071a76-32ed-4d72-a3d5-5e4b42bc689c/disk.config"/>
Jul 28 00:21:07 user nova-compute[70709]:       <target dev="hda" bus="ide"/>
Jul 28 00:21:07 user nova-compute[70709]:     </disk>
Jul 28 00:21:07 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:21:07 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:21:07 user nova-compute[70709]:       <source dev="/dev/sde"/>
Jul 28 00:21:07 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:21:07 user nova-compute[70709]:       <serial>34011d41-b1dd-4b79-837d-3c574de67abd</serial>
Jul 28 00:21:07 user nova-compute[70709]:     </disk>
Jul 28 00:21:07 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:21:07 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:21:07 user nova-compute[70709]:       <source dev="/dev/sdf"/>
Jul 28 00:21:07 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:21:07 user nova-compute[70709]:       <serial>16438393-b31a-4090-be62-9f763da2c251</serial>
Jul 28 00:21:07 user nova-compute[70709]:     </disk>
Jul 28 00:21:07 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:21:07 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:21:07 user nova-compute[70709]:       <source dev="/dev/sdg"/>
Jul 28 00:21:07 user nova-compute[70709]:       <target dev="vdc" bus="virtio"/>
Jul 28 00:21:07 user nova-compute[70709]:       <serial>d456834c-e70e-4daf-be6c-6e4d1870048d</serial>
Jul 28 00:21:07 user nova-compute[70709]:     </disk>
Jul 28 00:21:07 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:21:07 user nova-compute[70709]:       <mac address="fa:16:3e:a6:f1:19"/>
Jul 28 00:21:07 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:07 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:21:07 user nova-compute[70709]:       <target dev="tapf016184b-b5"/>
Jul 28 00:21:07 user nova-compute[70709]:     </interface>
Jul 28 00:21:07 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:21:07 user nova-compute[70709]:       <mac address="fa:16:3e:b1:e8:6c"/>
Jul 28 00:21:07 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:07 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:21:07 user nova-compute[70709]:       <target dev="tap013036a7-b1"/>
Jul 28 00:21:07 user nova-compute[70709]:     </interface>
Jul 28 00:21:07 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:21:07 user nova-compute[70709]:       <mac address="fa:16:3e:fd:90:0c"/>
Jul 28 00:21:07 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:07 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:21:07 user nova-compute[70709]:       <target dev="tapa7690ded-3d"/>
Jul 28 00:21:07 user nova-compute[70709]:     </interface>
Jul 28 00:21:07 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:21:07 user nova-compute[70709]:       <mac address="fa:16:3e:9e:54:c7"/>
Jul 28 00:21:07 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:07 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:21:07 user nova-compute[70709]:       <target dev="tap9d835d57-22"/>
Jul 28 00:21:07 user nova-compute[70709]:     </interface>
Jul 28 00:21:07 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:21:07 user nova-compute[70709]:       <mac address="fa:16:3e:5b:ac:be"/>
Jul 28 00:21:07 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:07 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:21:07 user nova-compute[70709]:       <target dev="tapff930c20-06"/>
Jul 28 00:21:07 user nova-compute[70709]:     </interface>
Jul 28 00:21:07 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:21:07 user nova-compute[70709]:       <mac address="fa:16:3e:91:9b:3b"/>
Jul 28 00:21:07 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:07 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:21:07 user nova-compute[70709]:       <target dev="tap7a7bdc1c-85"/>
Jul 28 00:21:07 user nova-compute[70709]:     </interface>
Jul 28 00:21:07 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:21:07 user nova-compute[70709]:       <mac address="fa:16:3e:78:29:e7"/>
Jul 28 00:21:07 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:07 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:21:07 user nova-compute[70709]:       <target dev="tapc4d13f1c-c3"/>
Jul 28 00:21:07 user nova-compute[70709]:     </interface>
Jul 28 00:21:07 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:21:07 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/3b071a76-32ed-4d72-a3d5-5e4b42bc689c/console.log" append="off"/>
Jul 28 00:21:07 user nova-compute[70709]:     </serial>
Jul 28 00:21:07 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:21:07 user nova-compute[70709]:     <video>
Jul 28 00:21:07 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:07 user nova-compute[70709]:     </video>
Jul 28 00:21:07 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:21:07 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:21:07 user nova-compute[70709]:     </rng>
Jul 28 00:21:07 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:21:07 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:21:07 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:21:07 user nova-compute[70709]:     </memballoon>
Jul 28 00:21:07 user nova-compute[70709]:   </devices>
Jul 28 00:21:07 user nova-compute[70709]: </domain>
Jul 28 00:21:07 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "address": "fa:16:3e:a6:f1:19", "network": {"id": "2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1149022988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf016184b-b5", "ovs_interfaceid": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "address": "fa:16:3e:a6:f1:19", "network": {"id": "2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1149022988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf016184b-b5", "ovs_interfaceid": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f1:19,bridge_name='br-int',has_traffic_filtering=True,id=f016184b-b548-4b42-ba6d-34dfa078dc0d,network=Network(2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf016184b-b5') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f1:19,bridge_name='br-int',has_traffic_filtering=True,id=f016184b-b548-4b42-ba6d-34dfa078dc0d,network=Network(2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf016184b-b5') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf016184b-b5, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf016184b-b5, col_values=(('external_ids', {'iface-id': 'f016184b-b548-4b42-ba6d-34dfa078dc0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:f1:19', 'vm-uuid': '3b071a76-32ed-4d72-a3d5-5e4b42bc689c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: INFO os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f1:19,bridge_name='br-int',has_traffic_filtering=True,id=f016184b-b548-4b42-ba6d-34dfa078dc0d,network=Network(2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf016184b-b5')
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=013036a7-b111-4260-b252-7607b25c720a,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap013036a7-b1') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=013036a7-b111-4260-b252-7607b25c720a,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap013036a7-b1') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap013036a7-b1, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap013036a7-b1, col_values=(('external_ids', {'iface-id': '013036a7-b111-4260-b252-7607b25c720a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:e8:6c', 'vm-uuid': '3b071a76-32ed-4d72-a3d5-5e4b42bc689c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.152s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: INFO os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=013036a7-b111-4260-b252-7607b25c720a,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap013036a7-b1')
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:90:0c,bridge_name='br-int',has_traffic_filtering=True,id=a7690ded-3dff-429d-8c20-45ee6ee8f662,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa7690ded-3d') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:90:0c,bridge_name='br-int',has_traffic_filtering=True,id=a7690ded-3dff-429d-8c20-45ee6ee8f662,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa7690ded-3d') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7690ded-3d, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7690ded-3d, col_values=(('external_ids', {'iface-id': 'a7690ded-3dff-429d-8c20-45ee6ee8f662', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:90:0c', 'vm-uuid': '3b071a76-32ed-4d72-a3d5-5e4b42bc689c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: INFO os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:90:0c,bridge_name='br-int',has_traffic_filtering=True,id=a7690ded-3dff-429d-8c20-45ee6ee8f662,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa7690ded-3d')
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=9d835d57-22e1-4a6a-bccd-97bcd8607cb4,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d835d57-22') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=9d835d57-22e1-4a6a-bccd-97bcd8607cb4,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d835d57-22') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d835d57-22, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d835d57-22, col_values=(('external_ids', {'iface-id': '9d835d57-22e1-4a6a-bccd-97bcd8607cb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:54:c7', 'vm-uuid': '3b071a76-32ed-4d72-a3d5-5e4b42bc689c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: INFO os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=9d835d57-22e1-4a6a-bccd-97bcd8607cb4,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d835d57-22')
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=ff930c20-069f-496d-9883-84907c2eb856,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff930c20-06') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=ff930c20-069f-496d-9883-84907c2eb856,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff930c20-06') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk 1073741824" returned: 0 in 0.054s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff930c20-06, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff930c20-06, col_values=(('external_ids', {'iface-id': 'ff930c20-069f-496d-9883-84907c2eb856', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:ac:be', 'vm-uuid': '3b071a76-32ed-4d72-a3d5-5e4b42bc689c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: INFO os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=ff930c20-069f-496d-9883-84907c2eb856,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff930c20-06')
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:9b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7a7bdc1c-851d-431e-9ca0-f2477e1caf39,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7bdc1c-85') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:9b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7a7bdc1c-851d-431e-9ca0-f2477e1caf39,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7bdc1c-85') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a7bdc1c-85, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a7bdc1c-85, col_values=(('external_ids', {'iface-id': '7a7bdc1c-851d-431e-9ca0-f2477e1caf39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:9b:3b', 'vm-uuid': '3b071a76-32ed-4d72-a3d5-5e4b42bc689c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: INFO os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:9b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7a7bdc1c-851d-431e-9ca0-f2477e1caf39,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7bdc1c-85')
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:29:e7,bridge_name='br-int',has_traffic_filtering=True,id=c4d13f1c-c3f9-4c10-a54f-03a180c736a8,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d13f1c-c3') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:29:e7,bridge_name='br-int',has_traffic_filtering=True,id=c4d13f1c-c3f9-4c10-a54f-03a180c736a8,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d13f1c-c3') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4d13f1c-c3, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4d13f1c-c3, col_values=(('external_ids', {'iface-id': 'c4d13f1c-c3f9-4c10-a54f-03a180c736a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:29:e7', 'vm-uuid': '3b071a76-32ed-4d72-a3d5-5e4b42bc689c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Successfully created port: 96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Cannot resize image /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'migration_context' on Instance uuid 75132de4-0252-4bee-bb51-24602cc586ba {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:07 user nova-compute[70709]: INFO os_vif [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:29:e7,bridge_name='br-int',has_traffic_filtering=True,id=c4d13f1c-c3f9-4c10-a54f-03a180c736a8,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d13f1c-c3')
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Ensure instance console log exists: /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:07 user nova-compute[70709]: INFO nova.compute.manager [None req-a65aea92-4ae6-43d5-9acf-b456e13caed5 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Unrescuing
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a65aea92-4ae6-43d5-9acf-b456e13caed5 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a65aea92-4ae6-43d5-9acf-b456e13caed5 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquired lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a65aea92-4ae6-43d5-9acf-b456e13caed5 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] No BDM found with device name hda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] No VIF found with MAC fa:16:3e:a6:f1:19, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:21:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] No VIF found with MAC fa:16:3e:5b:ac:be, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:21:07 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Using config drive
Jul 28 00:21:08 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Creating config drive at /opt/stack/data/nova/instances/3b071a76-32ed-4d72-a3d5-5e4b42bc689c/disk.config
Jul 28 00:21:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3b071a76-32ed-4d72-a3d5-5e4b42bc689c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprge1763y {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3b071a76-32ed-4d72-a3d5-5e4b42bc689c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprge1763y" returned: 0 in 0.061s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a65aea92-4ae6-43d5-9acf-b456e13caed5 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Updating instance_info_cache with network_info: [{"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a65aea92-4ae6-43d5-9acf-b456e13caed5 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Releasing lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a65aea92-4ae6-43d5-9acf-b456e13caed5 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'flavor' on Instance uuid 159a0ce2-f6b6-45bf-a743-74da642a79fe {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Successfully updated port: 96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "refresh_cache-75132de4-0252-4bee-bb51-24602cc586ba" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquired lock "refresh_cache-75132de4-0252-4bee-bb51-24602cc586ba" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-9b50b174-da25-4fb5-950d-2544beaf7e6a req-68d580e7-7196-4c10-b6bb-821b69ed9dd1 service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Received event network-changed-96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-9b50b174-da25-4fb5-950d-2544beaf7e6a req-68d580e7-7196-4c10-b6bb-821b69ed9dd1 service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Refreshing instance network info cache due to event network-changed-96ca7876-737c-4df3-ac1b-c778b5daae59. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9b50b174-da25-4fb5-950d-2544beaf7e6a req-68d580e7-7196-4c10-b6bb-821b69ed9dd1 service nova] Acquiring lock "refresh_cache-75132de4-0252-4bee-bb51-24602cc586ba" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-74a94b7a-a44b-42a7-aac6-85094019791a req-f5d62396-0acd-4ccf-a70f-3b88d0456bdb service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-unplugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-74a94b7a-a44b-42a7-aac6-85094019791a req-f5d62396-0acd-4ccf-a70f-3b88d0456bdb service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-74a94b7a-a44b-42a7-aac6-85094019791a req-f5d62396-0acd-4ccf-a70f-3b88d0456bdb service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-74a94b7a-a44b-42a7-aac6-85094019791a req-f5d62396-0acd-4ccf-a70f-3b88d0456bdb service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-74a94b7a-a44b-42a7-aac6-85094019791a req-f5d62396-0acd-4ccf-a70f-3b88d0456bdb service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-unplugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:08 user nova-compute[70709]: WARNING nova.compute.manager [req-74a94b7a-a44b-42a7-aac6-85094019791a req-f5d62396-0acd-4ccf-a70f-3b88d0456bdb service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received unexpected event network-vif-unplugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:21:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Updating instance_info_cache with network_info: [{"id": "96ca7876-737c-4df3-ac1b-c778b5daae59", "address": "fa:16:3e:de:67:06", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ca7876-73", "ovs_interfaceid": "96ca7876-737c-4df3-ac1b-c778b5daae59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Releasing lock "refresh_cache-75132de4-0252-4bee-bb51-24602cc586ba" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Instance network_info: |[{"id": "96ca7876-737c-4df3-ac1b-c778b5daae59", "address": "fa:16:3e:de:67:06", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ca7876-73", "ovs_interfaceid": "96ca7876-737c-4df3-ac1b-c778b5daae59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9b50b174-da25-4fb5-950d-2544beaf7e6a req-68d580e7-7196-4c10-b6bb-821b69ed9dd1 service nova] Acquired lock "refresh_cache-75132de4-0252-4bee-bb51-24602cc586ba" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.network.neutron [req-9b50b174-da25-4fb5-950d-2544beaf7e6a req-68d580e7-7196-4c10-b6bb-821b69ed9dd1 service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Refreshing network info cache for port 96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Start _get_guest_xml network_info=[{"id": "96ca7876-737c-4df3-ac1b-c778b5daae59", "address": "fa:16:3e:de:67:06", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ca7876-73", "ovs_interfaceid": "96ca7876-737c-4df3-ac1b-c778b5daae59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:09 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:21:09 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1592643157',display_name='tempest-AttachVolumeNegativeTest-server-1592643157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1592643157',id=19,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5VpuERWBc3WeIkgcuWj6gddD6oaXM+Zo0aHnlJ836sZ+4ho5UZoH+zBLGB+Mb2nrt+Ya/ojlNitzOEs3MXei5OhA7geJ4Pbl9BqU0k5VNW7EKZGcDogP7/NKDGLJ0k2w==',key_name='tempest-keypair-351284796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-zezjxndt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=75132de4-0252-4bee-bb51-24602cc586ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ca7876-737c-4df3-ac1b-c778b5daae59", "address": "fa:16:3e:de:67:06", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ca7876-73", "ovs_interfaceid": "96ca7876-737c-4df3-ac1b-c778b5daae59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "96ca7876-737c-4df3-ac1b-c778b5daae59", "address": "fa:16:3e:de:67:06", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ca7876-73", "ovs_interfaceid": "96ca7876-737c-4df3-ac1b-c778b5daae59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:67:06,bridge_name='br-int',has_traffic_filtering=True,id=96ca7876-737c-4df3-ac1b-c778b5daae59,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ca7876-73') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'pci_devices' on Instance uuid 75132de4-0252-4bee-bb51-24602cc586ba {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:21:09 user nova-compute[70709]:   <uuid>75132de4-0252-4bee-bb51-24602cc586ba</uuid>
Jul 28 00:21:09 user nova-compute[70709]:   <name>instance-00000013</name>
Jul 28 00:21:09 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:21:09 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:21:09 user nova-compute[70709]:   <metadata>
Jul 28 00:21:09 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:21:09 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:21:09 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1592643157</nova:name>
Jul 28 00:21:09 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:21:09</nova:creationTime>
Jul 28 00:21:09 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:21:09 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:21:09 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:21:09 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:21:09 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:21:09 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:21:09 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:21:09 user nova-compute[70709]:       <nova:owner>
Jul 28 00:21:09 user nova-compute[70709]:         <nova:user uuid="d8557f7232a94f76982b8840c534a6d4">tempest-AttachVolumeNegativeTest-337281402-project-member</nova:user>
Jul 28 00:21:09 user nova-compute[70709]:         <nova:project uuid="e05b559855734f9e9b221ec954881ccd">tempest-AttachVolumeNegativeTest-337281402</nova:project>
Jul 28 00:21:09 user nova-compute[70709]:       </nova:owner>
Jul 28 00:21:09 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:21:09 user nova-compute[70709]:       <nova:ports>
Jul 28 00:21:09 user nova-compute[70709]:         <nova:port uuid="96ca7876-737c-4df3-ac1b-c778b5daae59">
Jul 28 00:21:09 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 28 00:21:09 user nova-compute[70709]:         </nova:port>
Jul 28 00:21:09 user nova-compute[70709]:       </nova:ports>
Jul 28 00:21:09 user nova-compute[70709]:     </nova:instance>
Jul 28 00:21:09 user nova-compute[70709]:   </metadata>
Jul 28 00:21:09 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:21:09 user nova-compute[70709]:     <system>
Jul 28 00:21:09 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:21:09 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:21:09 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:21:09 user nova-compute[70709]:       <entry name="serial">75132de4-0252-4bee-bb51-24602cc586ba</entry>
Jul 28 00:21:09 user nova-compute[70709]:       <entry name="uuid">75132de4-0252-4bee-bb51-24602cc586ba</entry>
Jul 28 00:21:09 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:21:09 user nova-compute[70709]:     </system>
Jul 28 00:21:09 user nova-compute[70709]:   </sysinfo>
Jul 28 00:21:09 user nova-compute[70709]:   <os>
Jul 28 00:21:09 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:21:09 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:21:09 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:21:09 user nova-compute[70709]:   </os>
Jul 28 00:21:09 user nova-compute[70709]:   <features>
Jul 28 00:21:09 user nova-compute[70709]:     <acpi/>
Jul 28 00:21:09 user nova-compute[70709]:     <apic/>
Jul 28 00:21:09 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:21:09 user nova-compute[70709]:   </features>
Jul 28 00:21:09 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:21:09 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:21:09 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:21:09 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:21:09 user nova-compute[70709]:   </clock>
Jul 28 00:21:09 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:21:09 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:21:09 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:21:09 user nova-compute[70709]:   </cpu>
Jul 28 00:21:09 user nova-compute[70709]:   <devices>
Jul 28 00:21:09 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:21:09 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:21:09 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk"/>
Jul 28 00:21:09 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:21:09 user nova-compute[70709]:     </disk>
Jul 28 00:21:09 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:21:09 user nova-compute[70709]:       <mac address="fa:16:3e:de:67:06"/>
Jul 28 00:21:09 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:09 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:21:09 user nova-compute[70709]:       <target dev="tap96ca7876-73"/>
Jul 28 00:21:09 user nova-compute[70709]:     </interface>
Jul 28 00:21:09 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:21:09 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/console.log" append="off"/>
Jul 28 00:21:09 user nova-compute[70709]:     </serial>
Jul 28 00:21:09 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:21:09 user nova-compute[70709]:     <video>
Jul 28 00:21:09 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:09 user nova-compute[70709]:     </video>
Jul 28 00:21:09 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:21:09 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:21:09 user nova-compute[70709]:     </rng>
Jul 28 00:21:09 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:21:09 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:21:09 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:21:09 user nova-compute[70709]:     </memballoon>
Jul 28 00:21:09 user nova-compute[70709]:   </devices>
Jul 28 00:21:09 user nova-compute[70709]: </domain>
Jul 28 00:21:09 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1592643157',display_name='tempest-AttachVolumeNegativeTest-server-1592643157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1592643157',id=19,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5VpuERWBc3WeIkgcuWj6gddD6oaXM+Zo0aHnlJ836sZ+4ho5UZoH+zBLGB+Mb2nrt+Ya/ojlNitzOEs3MXei5OhA7geJ4Pbl9BqU0k5VNW7EKZGcDogP7/NKDGLJ0k2w==',key_name='tempest-keypair-351284796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-zezjxndt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=75132de4-0252-4bee-bb51-24602cc586ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ca7876-737c-4df3-ac1b-c778b5daae59", "address": "fa:16:3e:de:67:06", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ca7876-73", "ovs_interfaceid": "96ca7876-737c-4df3-ac1b-c778b5daae59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "96ca7876-737c-4df3-ac1b-c778b5daae59", "address": "fa:16:3e:de:67:06", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ca7876-73", "ovs_interfaceid": "96ca7876-737c-4df3-ac1b-c778b5daae59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:67:06,bridge_name='br-int',has_traffic_filtering=True,id=96ca7876-737c-4df3-ac1b-c778b5daae59,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ca7876-73') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG os_vif [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:67:06,bridge_name='br-int',has_traffic_filtering=True,id=96ca7876-737c-4df3-ac1b-c778b5daae59,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ca7876-73') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96ca7876-73, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96ca7876-73, col_values=(('external_ids', {'iface-id': '96ca7876-737c-4df3-ac1b-c778b5daae59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:67:06', 'vm-uuid': '75132de4-0252-4bee-bb51-24602cc586ba'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:09 user nova-compute[70709]: INFO os_vif [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:67:06,bridge_name='br-int',has_traffic_filtering=True,id=96ca7876-737c-4df3-ac1b-c778b5daae59,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ca7876-73')
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No VIF found with MAC fa:16:3e:de:67:06, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.network.neutron [req-9b50b174-da25-4fb5-950d-2544beaf7e6a req-68d580e7-7196-4c10-b6bb-821b69ed9dd1 service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Updated VIF entry in instance network info cache for port 96ca7876-737c-4df3-ac1b-c778b5daae59. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG nova.network.neutron [req-9b50b174-da25-4fb5-950d-2544beaf7e6a req-68d580e7-7196-4c10-b6bb-821b69ed9dd1 service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Updating instance_info_cache with network_info: [{"id": "96ca7876-737c-4df3-ac1b-c778b5daae59", "address": "fa:16:3e:de:67:06", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ca7876-73", "ovs_interfaceid": "96ca7876-737c-4df3-ac1b-c778b5daae59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:21:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9b50b174-da25-4fb5-950d-2544beaf7e6a req-68d580e7-7196-4c10-b6bb-821b69ed9dd1 service nova] Releasing lock "refresh_cache-75132de4-0252-4bee-bb51-24602cc586ba" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:21:09 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Instance destroyed successfully.
Jul 28 00:21:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-79179510-4ad4-4190-86a2-884872512d5b req-0d236330-5383-4554-a742-598aaa652869 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-79179510-4ad4-4190-86a2-884872512d5b req-0d236330-5383-4554-a742-598aaa652869 service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-79179510-4ad4-4190-86a2-884872512d5b req-0d236330-5383-4554-a742-598aaa652869 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-79179510-4ad4-4190-86a2-884872512d5b req-0d236330-5383-4554-a742-598aaa652869 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-79179510-4ad4-4190-86a2-884872512d5b req-0d236330-5383-4554-a742-598aaa652869 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:10 user nova-compute[70709]: WARNING nova.compute.manager [req-79179510-4ad4-4190-86a2-884872512d5b req-0d236330-5383-4554-a742-598aaa652869 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received unexpected event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:21:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:21:11 user nova-compute[70709]: INFO nova.compute.claims [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Claim successful on node user
Jul 28 00:21:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-a262b57e-8f17-4adc-91b0-bcba0bfc44a6 req-58a4766b-33e2-4f22-b3ad-3842ad2bd776 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-013036a7-b111-4260-b252-7607b25c720a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a262b57e-8f17-4adc-91b0-bcba0bfc44a6 req-58a4766b-33e2-4f22-b3ad-3842ad2bd776 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a262b57e-8f17-4adc-91b0-bcba0bfc44a6 req-58a4766b-33e2-4f22-b3ad-3842ad2bd776 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a262b57e-8f17-4adc-91b0-bcba0bfc44a6 req-58a4766b-33e2-4f22-b3ad-3842ad2bd776 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-a262b57e-8f17-4adc-91b0-bcba0bfc44a6 req-58a4766b-33e2-4f22-b3ad-3842ad2bd776 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-013036a7-b111-4260-b252-7607b25c720a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:12 user nova-compute[70709]: WARNING nova.compute.manager [req-a262b57e-8f17-4adc-91b0-bcba0bfc44a6 req-58a4766b-33e2-4f22-b3ad-3842ad2bd776 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-013036a7-b111-4260-b252-7607b25c720a for instance with vm_state building and task_state spawning.
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:21:12 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:12 user nova-compute[70709]: INFO nova.virt.block_device [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Booting with volume 57830a9a-041e-4dc0-b2e7-ae09961e9860 at /dev/vda
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.policy [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b436a6349354f97a81ea3977aec28a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce0f27cc343a5ac86331ee21076ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG os_brick.utils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2b2d8c-84a5-4b12-8bb6-8bf21960d4df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3be100-1e7a-4df4-b578-07176855a70b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4ce60f-dc7f-43f0-b126-21d97b2bf27d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3c5d97-83ab-4255-a181-bbab604142a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:21:12 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e40585-c418-4c18-9c12-7a86b570aab3]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG os_brick.utils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Updating existing volume attachment record: 638669be-e35d-47ee-a004-db5a36ccfd8a {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-495f5aa8-c553-45c7-abb8-df361488c271 req-76482d03-d4a2-4459-b962-7b666f111895 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-495f5aa8-c553-45c7-abb8-df361488c271 req-76482d03-d4a2-4459-b962-7b666f111895 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-495f5aa8-c553-45c7-abb8-df361488c271 req-76482d03-d4a2-4459-b962-7b666f111895 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-495f5aa8-c553-45c7-abb8-df361488c271 req-76482d03-d4a2-4459-b962-7b666f111895 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-495f5aa8-c553-45c7-abb8-df361488c271 req-76482d03-d4a2-4459-b962-7b666f111895 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:12 user nova-compute[70709]: WARNING nova.compute.manager [req-495f5aa8-c553-45c7-abb8-df361488c271 req-76482d03-d4a2-4459-b962-7b666f111895 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 for instance with vm_state building and task_state spawning.
Jul 28 00:21:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:12 user nova-compute[70709]: WARNING nova.compute.manager [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-f016184b-b548-4b42-ba6d-34dfa078dc0d for instance with vm_state building and task_state spawning.
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:12 user nova-compute[70709]: WARNING nova.compute.manager [req-63ecada9-3e34-46b6-b88d-93b1b85cef5f req-92af93a2-3f01-434b-8e10-0b9ff598dd57 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-f016184b-b548-4b42-ba6d-34dfa078dc0d for instance with vm_state building and task_state spawning.
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Successfully created port: 3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-013036a7-b111-4260-b252-7607b25c720a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-013036a7-b111-4260-b252-7607b25c720a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:14 user nova-compute[70709]: WARNING nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-013036a7-b111-4260-b252-7607b25c720a for instance with vm_state building and task_state spawning.
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Received event network-vif-plugged-96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Acquiring lock "75132de4-0252-4bee-bb51-24602cc586ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Lock "75132de4-0252-4bee-bb51-24602cc586ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Lock "75132de4-0252-4bee-bb51-24602cc586ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] No waiting events found dispatching network-vif-plugged-96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:14 user nova-compute[70709]: WARNING nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Received unexpected event network-vif-plugged-96ca7876-737c-4df3-ac1b-c778b5daae59 for instance with vm_state building and task_state spawning.
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Received event network-vif-plugged-96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Acquiring lock "75132de4-0252-4bee-bb51-24602cc586ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Lock "75132de4-0252-4bee-bb51-24602cc586ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Lock "75132de4-0252-4bee-bb51-24602cc586ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] No waiting events found dispatching network-vif-plugged-96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:14 user nova-compute[70709]: WARNING nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Received unexpected event network-vif-plugged-96ca7876-737c-4df3-ac1b-c778b5daae59 for instance with vm_state building and task_state spawning.
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:14 user nova-compute[70709]: WARNING nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 for instance with vm_state building and task_state spawning.
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:14 user nova-compute[70709]: WARNING nova.compute.manager [req-b118e5ac-97be-4752-9256-7a7fa6ddfc94 req-5f3857ff-f2bc-4b80-b808-38dd86c1828d service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 for instance with vm_state building and task_state spawning.
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Successfully updated port: 3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "refresh_cache-552ba43b-6f39-4a9d-a93e-bb2831324d01" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquired lock "refresh_cache-552ba43b-6f39-4a9d-a93e-bb2831324d01" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:14 user nova-compute[70709]: WARNING nova.compute.manager [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 for instance with vm_state building and task_state spawning.
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-changed-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Refreshing instance network info cache due to event network-changed-3bf19206-8843-4662-a147-edec46431a9b. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:21:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] Acquiring lock "refresh_cache-552ba43b-6f39-4a9d-a93e-bb2831324d01" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-77d81773-649c-4b2f-bf7b-bb1329da96c4 req-a5fc9876-cb11-4b82-9d1c-e341c4de1c05 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-77d81773-649c-4b2f-bf7b-bb1329da96c4 req-a5fc9876-cb11-4b82-9d1c-e341c4de1c05 service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-77d81773-649c-4b2f-bf7b-bb1329da96c4 req-a5fc9876-cb11-4b82-9d1c-e341c4de1c05 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-77d81773-649c-4b2f-bf7b-bb1329da96c4 req-a5fc9876-cb11-4b82-9d1c-e341c4de1c05 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-77d81773-649c-4b2f-bf7b-bb1329da96c4 req-a5fc9876-cb11-4b82-9d1c-e341c4de1c05 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:15 user nova-compute[70709]: WARNING nova.compute.manager [req-77d81773-649c-4b2f-bf7b-bb1329da96c4 req-a5fc9876-cb11-4b82-9d1c-e341c4de1c05 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received unexpected event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:21:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Updating instance_info_cache with network_info: [{"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Releasing lock "refresh_cache-552ba43b-6f39-4a9d-a93e-bb2831324d01" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Instance network_info: |[{"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] Acquired lock "refresh_cache-552ba43b-6f39-4a9d-a93e-bb2831324d01" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG nova.network.neutron [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Refreshing network info cache for port 3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:16 user nova-compute[70709]: WARNING nova.compute.manager [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 for instance with vm_state building and task_state spawning.
Jul 28 00:21:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:16 user nova-compute[70709]: WARNING nova.compute.manager [req-711a3993-a2b3-4c9c-8194-d8a0a87b0794 req-924e599b-8c35-4931-8690-6990f52c96a6 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 for instance with vm_state building and task_state spawning.
Jul 28 00:21:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG nova.network.neutron [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Updated VIF entry in instance network info cache for port 3bf19206-8843-4662-a147-edec46431a9b. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG nova.network.neutron [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Updating instance_info_cache with network_info: [{"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-72fcd79b-3c00-41b7-87b1-67522c029326 req-ca33d51f-1d06-4420-a702-d8c290ee44ca service nova] Releasing lock "refresh_cache-552ba43b-6f39-4a9d-a93e-bb2831324d01" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:17 user nova-compute[70709]: WARNING nova.compute.manager [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 for instance with vm_state building and task_state spawning.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:17 user nova-compute[70709]: WARNING nova.compute.manager [req-a93ca43b-9e7d-4137-b6d3-43e4e741c3b9 req-e5b6f61b-f387-41e3-97a7-760c86552b4b service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 for instance with vm_state building and task_state spawning.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:17 user nova-compute[70709]: WARNING nova.compute.manager [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received unexpected event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:17 user nova-compute[70709]: WARNING nova.compute.manager [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-ff930c20-069f-496d-9883-84907c2eb856 for instance with vm_state building and task_state spawning.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:17 user nova-compute[70709]: WARNING nova.compute.manager [req-28593eec-ac22-4bf9-9ece-567ca9242882 req-a2cfae7b-18b2-44a7-8a0e-6851e27eb1e2 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-ff930c20-069f-496d-9883-84907c2eb856 for instance with vm_state building and task_state spawning.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503677.1451838, 75132de4-0252-4bee-bb51-24602cc586ba => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] VM Resumed (Lifecycle Event)
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Instance spawned successfully.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503677.1466115, 75132de4-0252-4bee-bb51-24602cc586ba => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] VM Started (Lifecycle Event)
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Took 10.25 seconds to spawn the instance on the hypervisor.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Took 11.13 seconds to build instance.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e764d803-5d67-48be-904f-15b1ae60cf67 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.231s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for 159a0ce2-f6b6-45bf-a743-74da642a79fe due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503677.681622, 159a0ce2-f6b6-45bf-a743-74da642a79fe => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] VM Resumed (Lifecycle Event)
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a65aea92-4ae6-43d5-9acf-b456e13caed5 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503677.6853573, 159a0ce2-f6b6-45bf-a743-74da642a79fe => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] VM Started (Lifecycle Event)
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Instance spawned successfully.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503677.808138, 3b071a76-32ed-4d72-a3d5-5e4b42bc689c => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] VM Resumed (Lifecycle Event)
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503677.8085904, 3b071a76-32ed-4d72-a3d5-5e4b42bc689c => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:21:17 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] VM Started (Lifecycle Event)
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:21:18 user nova-compute[70709]: INFO nova.compute.manager [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Took 15.46 seconds to spawn the instance on the hypervisor.
Jul 28 00:21:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:18 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:18 user nova-compute[70709]: INFO nova.compute.manager [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Took 47.05 seconds to build instance.
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-120c2e85-5dcb-455e-a90f-4098918ffed2 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.264s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:19 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:21:19 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7560MB free_disk=25.22888946533203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance df55bbd3-31ab-42f8-9a71-4ed8e3c4428c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 8168aa39-afce-4c9e-ba76-78a760767357 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance c6297718-d595-4657-aa32-aa75bffdf955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 30ac2ae7-04f8-407e-8aee-1c515b61d564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 3b071a76-32ed-4d72-a3d5-5e4b42bc689c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 75132de4-0252-4bee-bb51-24602cc586ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 552ba43b-6f39-4a9d-a93e-bb2831324d01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:21:19 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:21:20 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:21:20 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:21:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:21:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:21:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:21:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:21:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:21:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:21:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:21:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:21:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:21:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:21:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:21:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Creating image(s)
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Ensure instance console log exists: /opt/stack/data/nova/instances/552ba43b-6f39-4a9d-a93e-bb2831324d01/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Start _get_guest_xml network_info=[{"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '638669be-e35d-47ee-a004-db5a36ccfd8a', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTJaFlYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '552ba43b-6f39-4a9d-a93e-bb2831324d01', 'attached_at': '', 'detached_at': '', 'volume_id': '57830a9a-041e-4dc0-b2e7-ae09961e9860', 'serial': '57830a9a-041e-4dc0-b2e7-ae09961e9860'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:21:26 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:21:26 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTJaFlYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:21:26 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:26 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:26 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aabadcc-66b6-4479-b936-a480da3db377]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:21:26 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67bb4d3-3652-4969-985c-9ecf5a144073]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860] added
Jul 28 00:21:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d5f463-32bf-41d6-b182-1c0e3b90014e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26367e9-cf20-4534-9120-6ff8ebb1a0ed]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTJaFlYG {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTJaFlYG" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[429379b0-ba18-43e6-ad10-0e950f983481]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pTJaFlYG'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24c344d-a566-4425-ac24-d8b69adf1dd6]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23d822c-6210-4f36-8c29-0cf185737ce4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e35d685-f918-41fd-862b-7549dce8abee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260]
Jul 28 00:21:26 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260] successful.
Jul 28 00:21:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[183b5039-0fbe-4ed6-9cfb-48b76a4f94bd]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf4c30f-9a6b-44c6-810d-1ad4fe728988]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:26 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:21:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] HCTL ('39', '-', '-', 0) found on session 25 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[997aba32-efa2-43a0-8653-db7408a582d5]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:26 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Searching for a device in session 25 and hctl ['39', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:27 user nova-compute[70709]: INFO nova.compute.manager [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Detaching volume 1d66a522-ca12-42a5-9cf4-e81ca64c1cd0
Jul 28 00:21:27 user nova-compute[70709]: INFO nova.virt.block_device [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Attempting to driver detach volume 1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 from mountpoint /dev/vdb
Jul 28 00:21:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Attempting to detach device vdb from instance b61aaab4-ca86-41e6-a576-a7174d89a284 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:21:27 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:21:27 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:21:27 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:21:27 user nova-compute[70709]:   <serial>1d66a522-ca12-42a5-9cf4-e81ca64c1cd0</serial>
Jul 28 00:21:27 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 28 00:21:27 user nova-compute[70709]: </disk>
Jul 28 00:21:27 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:21:27 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Successfully detached device vdb from instance b61aaab4-ca86-41e6-a576-a7174d89a284 from the persistent domain config.
Jul 28 00:21:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b61aaab4-ca86-41e6-a576-a7174d89a284 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:21:27 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:21:27 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:21:27 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:21:27 user nova-compute[70709]:   <serial>1d66a522-ca12-42a5-9cf4-e81ca64c1cd0</serial>
Jul 28 00:21:27 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 28 00:21:27 user nova-compute[70709]: </disk>
Jul 28 00:21:27 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Searching for a device in session 25 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTJaFlYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23763663461333133', 'path': '/dev/sdh'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763663461333133', 'path': '/dev/sdh'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503687.9749784, b61aaab4-ca86-41e6-a576-a7174d89a284 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:21:27 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Successfully detached device vdb from instance b61aaab4-ca86-41e6-a576-a7174d89a284 from the live domain config.
Jul 28 00:21:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljdBCQOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:21:27 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f909e9-ab00-4a96-bf51-fcff921a2b9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:21:28 user nova-compute[70709]: No targets found.
Jul 28 00:21:28 user nova-compute[70709]: iSNS:
Jul 28 00:21:28 user nova-compute[70709]: No targets found.
Jul 28 00:21:28 user nova-compute[70709]: STATIC:
Jul 28 00:21:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860
Jul 28 00:21:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:21:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:21:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:21:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:21:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:21:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:21:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:21:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:21:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d
Jul 28 00:21:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:21:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:21:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251
Jul 28 00:21:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:21:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:21:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0
Jul 28 00:21:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:21:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:21:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd
Jul 28 00:21:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:21:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:21:28 user nova-compute[70709]: FIRMWARE:
Jul 28 00:21:28 user nova-compute[70709]: No targets found.
Jul 28 00:21:28 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:21:28 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:21:28 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1150596554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1150596554',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTphqF5bcF3n3OoMRDgsPxmVaUYJwZyxO441ggHQIolrfJ5FpS+UvFhc6UHNKt8wYOsoG6vj9jSalQ6YygK6u0e05rHRBkpcdU+YG6jEUzfArQfV3iGatSOnUZeh6becA==',key_name='tempest-keypair-382930470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='526ce0f27cc343a5ac86331ee21076ec',ramdisk_id='',reservation_id='r-i95b6tf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1273279077',owner_user_name='tempest-ServerActionsV293TestJSON-1273279077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b436a6349354f97a81ea3977aec28a5',uuid=552ba43b-6f39-4a9d-a93e-bb2831324d01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converting VIF {"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lazy-loading 'pci_devices' on Instance uuid 552ba43b-6f39-4a9d-a93e-bb2831324d01 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d707720-eefb-4c01-b915-18e66e0f2c07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:21:28 user nova-compute[70709]:   <uuid>552ba43b-6f39-4a9d-a93e-bb2831324d01</uuid>
Jul 28 00:21:28 user nova-compute[70709]:   <name>instance-00000014</name>
Jul 28 00:21:28 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:21:28 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:21:28 user nova-compute[70709]:   <metadata>
Jul 28 00:21:28 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:21:28 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:21:28 user nova-compute[70709]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1150596554</nova:name>
Jul 28 00:21:28 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:21:26</nova:creationTime>
Jul 28 00:21:28 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:21:28 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:21:28 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:21:28 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:21:28 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:21:28 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:21:28 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:21:28 user nova-compute[70709]:       <nova:owner>
Jul 28 00:21:28 user nova-compute[70709]:         <nova:user uuid="8b436a6349354f97a81ea3977aec28a5">tempest-ServerActionsV293TestJSON-1273279077-project-member</nova:user>
Jul 28 00:21:28 user nova-compute[70709]:         <nova:project uuid="526ce0f27cc343a5ac86331ee21076ec">tempest-ServerActionsV293TestJSON-1273279077</nova:project>
Jul 28 00:21:28 user nova-compute[70709]:       </nova:owner>
Jul 28 00:21:28 user nova-compute[70709]:       <nova:ports>
Jul 28 00:21:28 user nova-compute[70709]:         <nova:port uuid="3bf19206-8843-4662-a147-edec46431a9b">
Jul 28 00:21:28 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 28 00:21:28 user nova-compute[70709]:         </nova:port>
Jul 28 00:21:28 user nova-compute[70709]:       </nova:ports>
Jul 28 00:21:28 user nova-compute[70709]:     </nova:instance>
Jul 28 00:21:28 user nova-compute[70709]:   </metadata>
Jul 28 00:21:28 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:21:28 user nova-compute[70709]:     <system>
Jul 28 00:21:28 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:21:28 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:21:28 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:21:28 user nova-compute[70709]:       <entry name="serial">552ba43b-6f39-4a9d-a93e-bb2831324d01</entry>
Jul 28 00:21:28 user nova-compute[70709]:       <entry name="uuid">552ba43b-6f39-4a9d-a93e-bb2831324d01</entry>
Jul 28 00:21:28 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:21:28 user nova-compute[70709]:     </system>
Jul 28 00:21:28 user nova-compute[70709]:   </sysinfo>
Jul 28 00:21:28 user nova-compute[70709]:   <os>
Jul 28 00:21:28 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:21:28 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:21:28 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:21:28 user nova-compute[70709]:   </os>
Jul 28 00:21:28 user nova-compute[70709]:   <features>
Jul 28 00:21:28 user nova-compute[70709]:     <acpi/>
Jul 28 00:21:28 user nova-compute[70709]:     <apic/>
Jul 28 00:21:28 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:21:28 user nova-compute[70709]:   </features>
Jul 28 00:21:28 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:21:28 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:21:28 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:21:28 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:21:28 user nova-compute[70709]:   </clock>
Jul 28 00:21:28 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:21:28 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:21:28 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:21:28 user nova-compute[70709]:   </cpu>
Jul 28 00:21:28 user nova-compute[70709]:   <devices>
Jul 28 00:21:28 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:21:28 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:21:28 user nova-compute[70709]:       <source dev="/dev/sdh"/>
Jul 28 00:21:28 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:21:28 user nova-compute[70709]:       <serial>57830a9a-041e-4dc0-b2e7-ae09961e9860</serial>
Jul 28 00:21:28 user nova-compute[70709]:     </disk>
Jul 28 00:21:28 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:21:28 user nova-compute[70709]:       <mac address="fa:16:3e:7a:3c:b5"/>
Jul 28 00:21:28 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:28 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:21:28 user nova-compute[70709]:       <target dev="tap3bf19206-88"/>
Jul 28 00:21:28 user nova-compute[70709]:     </interface>
Jul 28 00:21:28 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:21:28 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/552ba43b-6f39-4a9d-a93e-bb2831324d01/console.log" append="off"/>
Jul 28 00:21:28 user nova-compute[70709]:     </serial>
Jul 28 00:21:28 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:21:28 user nova-compute[70709]:     <video>
Jul 28 00:21:28 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:28 user nova-compute[70709]:     </video>
Jul 28 00:21:28 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:21:28 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:21:28 user nova-compute[70709]:     </rng>
Jul 28 00:21:28 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:21:28 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:21:28 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:21:28 user nova-compute[70709]:     </memballoon>
Jul 28 00:21:28 user nova-compute[70709]:   </devices>
Jul 28 00:21:28 user nova-compute[70709]: </domain>
Jul 28 00:21:28 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1150596554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1150596554',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTphqF5bcF3n3OoMRDgsPxmVaUYJwZyxO441ggHQIolrfJ5FpS+UvFhc6UHNKt8wYOsoG6vj9jSalQ6YygK6u0e05rHRBkpcdU+YG6jEUzfArQfV3iGatSOnUZeh6becA==',key_name='tempest-keypair-382930470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='526ce0f27cc343a5ac86331ee21076ec',ramdisk_id='',reservation_id='r-i95b6tf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1273279077',owner_user_name='tempest-ServerActionsV293TestJSON-1273279077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b436a6349354f97a81ea3977aec28a5',uuid=552ba43b-6f39-4a9d-a93e-bb2831324d01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converting VIF {"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_vif [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bf19206-88, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3bf19206-88, col_values=(('external_ids', {'iface-id': '3bf19206-8843-4662-a147-edec46431a9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:3c:b5', 'vm-uuid': '552ba43b-6f39-4a9d-a93e-bb2831324d01'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e89622-80ff-47fc-9895-0d56c71b7570]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:21:28 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:28 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:21:28 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b905f4670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0'): ({'sdc'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Removing single pathed devices sdc {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:28 user nova-compute[70709]: INFO os_vif [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88')
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb655b3d-fd93-4f29-93f1-ec9fede2b477]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d200acc5-38c8-4202-bb28-76d24340ffe9]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flushing IO for device /dev/sdc {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] No VIF found with MAC fa:16:3e:7a:3c:b5, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4a3bdf-a779-4ea0-a4ac-8c456d501d95]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a12b0f-f17d-4b83-a2d4-eb1835f2a7f9]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e76b029-5e15-4cc8-9546-add5420bc893]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d691269-4bce-4a47-8085-727a9ce66882]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260]
Jul 28 00:21:28 user nova-compute[70709]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0, portal: 172.16.0.220,3260] successful.
Jul 28 00:21:28 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d66a522-ca12-42a5-9cf4-e81ca64c1cd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c27f33-2b90-43c7-aeb1-8aba38bdaeb2]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== disconnect_volume: return (394ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:21:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG nova.objects.instance [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'flavor' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-83d0b288-f678-4712-874e-a59bfb267c5b tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.775s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-3336040d-5f09-4fce-8c81-fbd92ddfa5b8 req-16557b71-82b1-492b-a08a-7bae2cf2d7e3 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3336040d-5f09-4fce-8c81-fbd92ddfa5b8 req-16557b71-82b1-492b-a08a-7bae2cf2d7e3 service nova] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3336040d-5f09-4fce-8c81-fbd92ddfa5b8 req-16557b71-82b1-492b-a08a-7bae2cf2d7e3 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3336040d-5f09-4fce-8c81-fbd92ddfa5b8 req-16557b71-82b1-492b-a08a-7bae2cf2d7e3 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-3336040d-5f09-4fce-8c81-fbd92ddfa5b8 req-16557b71-82b1-492b-a08a-7bae2cf2d7e3 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] No waiting events found dispatching network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:29 user nova-compute[70709]: WARNING nova.compute.manager [req-3336040d-5f09-4fce-8c81-fbd92ddfa5b8 req-16557b71-82b1-492b-a08a-7bae2cf2d7e3 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received unexpected event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b for instance with vm_state building and task_state spawning.
Jul 28 00:21:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503691.743866, 552ba43b-6f39-4a9d-a93e-bb2831324d01 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:21:31 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] VM Resumed (Lifecycle Event)
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:21:31 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Instance spawned successfully.
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:31 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503691.7477894, 552ba43b-6f39-4a9d-a93e-bb2831324d01 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:21:31 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] VM Started (Lifecycle Event)
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:21:31 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:21:31 user nova-compute[70709]: INFO nova.compute.manager [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Took 5.37 seconds to spawn the instance on the hypervisor.
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-9e5429c2-5d1f-4f77-afbb-4e9626b06461 req-7ce4df6d-de05-4f90-b385-32df9233cec1 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9e5429c2-5d1f-4f77-afbb-4e9626b06461 req-7ce4df6d-de05-4f90-b385-32df9233cec1 service nova] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9e5429c2-5d1f-4f77-afbb-4e9626b06461 req-7ce4df6d-de05-4f90-b385-32df9233cec1 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9e5429c2-5d1f-4f77-afbb-4e9626b06461 req-7ce4df6d-de05-4f90-b385-32df9233cec1 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-9e5429c2-5d1f-4f77-afbb-4e9626b06461 req-7ce4df6d-de05-4f90-b385-32df9233cec1 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] No waiting events found dispatching network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:31 user nova-compute[70709]: WARNING nova.compute.manager [req-9e5429c2-5d1f-4f77-afbb-4e9626b06461 req-7ce4df6d-de05-4f90-b385-32df9233cec1 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received unexpected event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b for instance with vm_state building and task_state spawning.
Jul 28 00:21:32 user nova-compute[70709]: INFO nova.compute.manager [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Took 20.49 seconds to build instance.
Jul 28 00:21:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a9d8f3d0-684f-44aa-b0b2-7690cb23c787 tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.685s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:21:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:21:34 user nova-compute[70709]: INFO nova.compute.claims [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Claim successful on node user
Jul 28 00:21:34 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:21:34 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:21:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:21:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:21:34 user nova-compute[70709]: DEBUG nova.network.neutron [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:21:34 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:21:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:21:35 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Creating image(s)
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "/opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "/opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG nova.policy [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1ee7cb9ed044e10a022b23f51bcb588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1181361da7694becb7e59b4b47eb0760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk 1073741824" returned: 0 in 0.061s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.156s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Cannot resize image /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG nova.objects.instance [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lazy-loading 'migration_context' on Instance uuid e5fa42c1-2530-48d2-807c-ffbf9b2b355f {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Ensure instance console log exists: /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:36 user nova-compute[70709]: DEBUG nova.network.neutron [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Successfully created port: 5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:21:36 user nova-compute[70709]: DEBUG nova.network.neutron [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Successfully updated port: 5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:21:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "refresh_cache-e5fa42c1-2530-48d2-807c-ffbf9b2b355f" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:21:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquired lock "refresh_cache-e5fa42c1-2530-48d2-807c-ffbf9b2b355f" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:21:36 user nova-compute[70709]: DEBUG nova.network.neutron [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:21:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-c8f400db-206e-464f-ad45-3cebdda969ad req-209d65e1-33df-4c3d-905b-4fa12ea4b97b service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Received event network-changed-5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-c8f400db-206e-464f-ad45-3cebdda969ad req-209d65e1-33df-4c3d-905b-4fa12ea4b97b service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Refreshing instance network info cache due to event network-changed-5cabbda0-4e7c-4ed5-a03b-23362bda59cd. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:21:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c8f400db-206e-464f-ad45-3cebdda969ad req-209d65e1-33df-4c3d-905b-4fa12ea4b97b service nova] Acquiring lock "refresh_cache-e5fa42c1-2530-48d2-807c-ffbf9b2b355f" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:21:36 user nova-compute[70709]: DEBUG nova.network.neutron [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:21:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.network.neutron [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Updating instance_info_cache with network_info: [{"id": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "address": "fa:16:3e:de:c0:67", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cabbda0-4e", "ovs_interfaceid": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Releasing lock "refresh_cache-e5fa42c1-2530-48d2-807c-ffbf9b2b355f" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Instance network_info: |[{"id": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "address": "fa:16:3e:de:c0:67", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cabbda0-4e", "ovs_interfaceid": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c8f400db-206e-464f-ad45-3cebdda969ad req-209d65e1-33df-4c3d-905b-4fa12ea4b97b service nova] Acquired lock "refresh_cache-e5fa42c1-2530-48d2-807c-ffbf9b2b355f" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-c8f400db-206e-464f-ad45-3cebdda969ad req-209d65e1-33df-4c3d-905b-4fa12ea4b97b service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Refreshing network info cache for port 5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Start _get_guest_xml network_info=[{"id": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "address": "fa:16:3e:de:c0:67", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cabbda0-4e", "ovs_interfaceid": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:21:37 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:21:37 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1733239116',display_name='tempest-VolumesAdminNegativeTest-server-1733239116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1733239116',id=21,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1181361da7694becb7e59b4b47eb0760',ramdisk_id='',reservation_id='r-xf66twu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-945099691',owner_user_name='tempest-VolumesAdminNegativeTest-945099691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:21:35Z,user_data=None,user_id='e1ee7cb9ed044e10a022b23f51bcb588',uuid=e5fa42c1-2530-48d2-807c-ffbf9b2b355f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "address": "fa:16:3e:de:c0:67", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cabbda0-4e", "ovs_interfaceid": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converting VIF {"id": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "address": "fa:16:3e:de:c0:67", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cabbda0-4e", "ovs_interfaceid": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=5cabbda0-4e7c-4ed5-a03b-23362bda59cd,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cabbda0-4e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.objects.instance [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lazy-loading 'pci_devices' on Instance uuid e5fa42c1-2530-48d2-807c-ffbf9b2b355f {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:21:37 user nova-compute[70709]:   <uuid>e5fa42c1-2530-48d2-807c-ffbf9b2b355f</uuid>
Jul 28 00:21:37 user nova-compute[70709]:   <name>instance-00000015</name>
Jul 28 00:21:37 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:21:37 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:21:37 user nova-compute[70709]:   <metadata>
Jul 28 00:21:37 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:21:37 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:21:37 user nova-compute[70709]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1733239116</nova:name>
Jul 28 00:21:37 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:21:37</nova:creationTime>
Jul 28 00:21:37 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:21:37 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:21:37 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:21:37 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:21:37 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:21:37 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:21:37 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:21:37 user nova-compute[70709]:       <nova:owner>
Jul 28 00:21:37 user nova-compute[70709]:         <nova:user uuid="e1ee7cb9ed044e10a022b23f51bcb588">tempest-VolumesAdminNegativeTest-945099691-project-member</nova:user>
Jul 28 00:21:37 user nova-compute[70709]:         <nova:project uuid="1181361da7694becb7e59b4b47eb0760">tempest-VolumesAdminNegativeTest-945099691</nova:project>
Jul 28 00:21:37 user nova-compute[70709]:       </nova:owner>
Jul 28 00:21:37 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:21:37 user nova-compute[70709]:       <nova:ports>
Jul 28 00:21:37 user nova-compute[70709]:         <nova:port uuid="5cabbda0-4e7c-4ed5-a03b-23362bda59cd">
Jul 28 00:21:37 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 28 00:21:37 user nova-compute[70709]:         </nova:port>
Jul 28 00:21:37 user nova-compute[70709]:       </nova:ports>
Jul 28 00:21:37 user nova-compute[70709]:     </nova:instance>
Jul 28 00:21:37 user nova-compute[70709]:   </metadata>
Jul 28 00:21:37 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:21:37 user nova-compute[70709]:     <system>
Jul 28 00:21:37 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:21:37 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:21:37 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:21:37 user nova-compute[70709]:       <entry name="serial">e5fa42c1-2530-48d2-807c-ffbf9b2b355f</entry>
Jul 28 00:21:37 user nova-compute[70709]:       <entry name="uuid">e5fa42c1-2530-48d2-807c-ffbf9b2b355f</entry>
Jul 28 00:21:37 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:21:37 user nova-compute[70709]:     </system>
Jul 28 00:21:37 user nova-compute[70709]:   </sysinfo>
Jul 28 00:21:37 user nova-compute[70709]:   <os>
Jul 28 00:21:37 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:21:37 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:21:37 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:21:37 user nova-compute[70709]:   </os>
Jul 28 00:21:37 user nova-compute[70709]:   <features>
Jul 28 00:21:37 user nova-compute[70709]:     <acpi/>
Jul 28 00:21:37 user nova-compute[70709]:     <apic/>
Jul 28 00:21:37 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:21:37 user nova-compute[70709]:   </features>
Jul 28 00:21:37 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:21:37 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:21:37 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:21:37 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:21:37 user nova-compute[70709]:   </clock>
Jul 28 00:21:37 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:21:37 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:21:37 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:21:37 user nova-compute[70709]:   </cpu>
Jul 28 00:21:37 user nova-compute[70709]:   <devices>
Jul 28 00:21:37 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:21:37 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:21:37 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk"/>
Jul 28 00:21:37 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:21:37 user nova-compute[70709]:     </disk>
Jul 28 00:21:37 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:21:37 user nova-compute[70709]:       <mac address="fa:16:3e:de:c0:67"/>
Jul 28 00:21:37 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:37 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:21:37 user nova-compute[70709]:       <target dev="tap5cabbda0-4e"/>
Jul 28 00:21:37 user nova-compute[70709]:     </interface>
Jul 28 00:21:37 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:21:37 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/console.log" append="off"/>
Jul 28 00:21:37 user nova-compute[70709]:     </serial>
Jul 28 00:21:37 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:21:37 user nova-compute[70709]:     <video>
Jul 28 00:21:37 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:21:37 user nova-compute[70709]:     </video>
Jul 28 00:21:37 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:21:37 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:21:37 user nova-compute[70709]:     </rng>
Jul 28 00:21:37 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:21:37 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:21:37 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:21:37 user nova-compute[70709]:     </memballoon>
Jul 28 00:21:37 user nova-compute[70709]:   </devices>
Jul 28 00:21:37 user nova-compute[70709]: </domain>
Jul 28 00:21:37 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1733239116',display_name='tempest-VolumesAdminNegativeTest-server-1733239116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1733239116',id=21,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1181361da7694becb7e59b4b47eb0760',ramdisk_id='',reservation_id='r-xf66twu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-945099691',owner_user_name='tempest-VolumesAdminNegativeTest-945099691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:21:35Z,user_data=None,user_id='e1ee7cb9ed044e10a022b23f51bcb588',uuid=e5fa42c1-2530-48d2-807c-ffbf9b2b355f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "address": "fa:16:3e:de:c0:67", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cabbda0-4e", "ovs_interfaceid": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converting VIF {"id": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "address": "fa:16:3e:de:c0:67", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cabbda0-4e", "ovs_interfaceid": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=5cabbda0-4e7c-4ed5-a03b-23362bda59cd,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cabbda0-4e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG os_vif [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=5cabbda0-4e7c-4ed5-a03b-23362bda59cd,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cabbda0-4e') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cabbda0-4e, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5cabbda0-4e, col_values=(('external_ids', {'iface-id': '5cabbda0-4e7c-4ed5-a03b-23362bda59cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:c0:67', 'vm-uuid': 'e5fa42c1-2530-48d2-807c-ffbf9b2b355f'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:37 user nova-compute[70709]: INFO os_vif [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=5cabbda0-4e7c-4ed5-a03b-23362bda59cd,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cabbda0-4e')
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] No VIF found with MAC fa:16:3e:de:c0:67, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-c8f400db-206e-464f-ad45-3cebdda969ad req-209d65e1-33df-4c3d-905b-4fa12ea4b97b service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Updated VIF entry in instance network info cache for port 5cabbda0-4e7c-4ed5-a03b-23362bda59cd. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-c8f400db-206e-464f-ad45-3cebdda969ad req-209d65e1-33df-4c3d-905b-4fa12ea4b97b service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Updating instance_info_cache with network_info: [{"id": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "address": "fa:16:3e:de:c0:67", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cabbda0-4e", "ovs_interfaceid": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:21:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c8f400db-206e-464f-ad45-3cebdda969ad req-209d65e1-33df-4c3d-905b-4fa12ea4b97b service nova] Releasing lock "refresh_cache-e5fa42c1-2530-48d2-807c-ffbf9b2b355f" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:21:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:39 user nova-compute[70709]: DEBUG nova.compute.manager [req-06ad3ce9-b9e6-46e8-a353-72cd46449b7d req-ed0d9872-e2d0-4e72-bf13-13a27770df92 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Received event network-vif-plugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-06ad3ce9-b9e6-46e8-a353-72cd46449b7d req-ed0d9872-e2d0-4e72-bf13-13a27770df92 service nova] Acquiring lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-06ad3ce9-b9e6-46e8-a353-72cd46449b7d req-ed0d9872-e2d0-4e72-bf13-13a27770df92 service nova] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-06ad3ce9-b9e6-46e8-a353-72cd46449b7d req-ed0d9872-e2d0-4e72-bf13-13a27770df92 service nova] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:39 user nova-compute[70709]: DEBUG nova.compute.manager [req-06ad3ce9-b9e6-46e8-a353-72cd46449b7d req-ed0d9872-e2d0-4e72-bf13-13a27770df92 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] No waiting events found dispatching network-vif-plugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:39 user nova-compute[70709]: WARNING nova.compute.manager [req-06ad3ce9-b9e6-46e8-a353-72cd46449b7d req-ed0d9872-e2d0-4e72-bf13-13a27770df92 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Received unexpected event network-vif-plugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd for instance with vm_state building and task_state spawning.
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-999ca889-f768-41be-80ff-408adce44637 req-99761f40-2b15-4473-93f1-717ff34e1e63 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Received event network-vif-plugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-999ca889-f768-41be-80ff-408adce44637 req-99761f40-2b15-4473-93f1-717ff34e1e63 service nova] Acquiring lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-999ca889-f768-41be-80ff-408adce44637 req-99761f40-2b15-4473-93f1-717ff34e1e63 service nova] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-999ca889-f768-41be-80ff-408adce44637 req-99761f40-2b15-4473-93f1-717ff34e1e63 service nova] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-999ca889-f768-41be-80ff-408adce44637 req-99761f40-2b15-4473-93f1-717ff34e1e63 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] No waiting events found dispatching network-vif-plugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:41 user nova-compute[70709]: WARNING nova.compute.manager [req-999ca889-f768-41be-80ff-408adce44637 req-99761f40-2b15-4473-93f1-717ff34e1e63 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Received unexpected event network-vif-plugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd for instance with vm_state building and task_state spawning.
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503701.7876816, e5fa42c1-2530-48d2-807c-ffbf9b2b355f => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:21:41 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] VM Resumed (Lifecycle Event)
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:21:41 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Instance spawned successfully.
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:21:41 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503701.7910335, e5fa42c1-2530-48d2-807c-ffbf9b2b355f => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:21:41 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] VM Started (Lifecycle Event)
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:21:41 user nova-compute[70709]: INFO nova.compute.manager [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Took 6.70 seconds to spawn the instance on the hypervisor.
Jul 28 00:21:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:21:41 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:21:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:42 user nova-compute[70709]: INFO nova.compute.manager [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Took 7.78 seconds to build instance.
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97fc0750-2c19-40a1-a456-74f017dde469 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.882s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG nova.objects.instance [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'flavor' on Instance uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:42 user nova-compute[70709]: INFO nova.compute.manager [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Attaching volume 8be09f2b-9c75-4381-8295-df8913d7878a to /dev/vdb
Jul 28 00:21:42 user nova-compute[70709]: DEBUG os_brick.utils [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4ea3b4-ee0b-4cfd-9086-60ac0352344c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fdaa5b-e7c0-4418-b1fe-a10787c6a12d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9ff0b1-9e65-4d97-8cd3-22a6629a384d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b16ebd-c94a-4321-892c-0c988bc69604]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:42 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:21:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:21:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:21:43 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:21:43 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d22bf9-8c9b-4a52-8c95-6fa7a32c9e0e]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:21:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:21:43 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:21:43 user nova-compute[70709]: DEBUG os_brick.utils [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:21:43 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updating existing volume attachment record: df7c4b86-57a9-44d5-80e0-12888a4c88fb {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:21:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBjrhtSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:21:51 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:51 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:21:51 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d3bcbc-3c40-4f1c-87e4-5b787db0ef65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:21:51 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2dccfc-eb75-49b1-aaa3-7e4756e6cf4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a] added
Jul 28 00:21:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d50389b-4d4b-42ae-a1ad-cd86f742a106]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[09126b0c-6663-4e05-903a-3c0eccd402b7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBjrhtSN {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBjrhtSN" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cf1b3a-f5e5-4a51-b68c-e2074ad0e544]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GBjrhtSN'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[345f0735-3c44-4abb-ab29-4591d0be9373]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8792d0f6-94e4-469b-8bda-6190f95d64d8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6b1404-c842-4fb0-8029-ba229dda0f27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260]
Jul 28 00:21:51 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260] successful.
Jul 28 00:21:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[077a4451-b491-40ad-b081-c954bf3b31ee]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3f9cdf-f62e-44d7-b6c2-432418a2b83d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:21:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:21:51 user nova-compute[70709]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:21:51 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5c2cb8-9b71-45db-af96-85941cb94ba3]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:21:51 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBjrhtSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:21:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:52 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:21:52 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26561343838643665', 'path': '/dev/sdc'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:21:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561343838643665', 'path': '/dev/sdc'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:21:52 user nova-compute[70709]: DEBUG nova.objects.instance [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'flavor' on Instance uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:21:52 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:21:52 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:21:52 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:21:52 user nova-compute[70709]:   <serial>8be09f2b-9c75-4381-8295-df8913d7878a</serial>
Jul 28 00:21:52 user nova-compute[70709]: </disk>
Jul 28 00:21:52 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:21:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:21:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:21:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] No VIF found with MAC fa:16:3e:6d:4b:f5, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:21:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0a37dccf-0716-480f-be6c-402933b5fadf tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.529s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:55 user nova-compute[70709]: INFO nova.compute.manager [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Terminating instance
Jul 28 00:21:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:21:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-d3cfac29-bcee-45b4-9279-3a4daf6236f6 req-575b11ce-ed80-4c6d-8d15-49fe54f3a89a service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-unplugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d3cfac29-bcee-45b4-9279-3a4daf6236f6 req-575b11ce-ed80-4c6d-8d15-49fe54f3a89a service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d3cfac29-bcee-45b4-9279-3a4daf6236f6 req-575b11ce-ed80-4c6d-8d15-49fe54f3a89a service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d3cfac29-bcee-45b4-9279-3a4daf6236f6 req-575b11ce-ed80-4c6d-8d15-49fe54f3a89a service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-d3cfac29-bcee-45b4-9279-3a4daf6236f6 req-575b11ce-ed80-4c6d-8d15-49fe54f3a89a service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-unplugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-d3cfac29-bcee-45b4-9279-3a4daf6236f6 req-575b11ce-ed80-4c6d-8d15-49fe54f3a89a service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-unplugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:21:56 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Instance destroyed successfully.
Jul 28 00:21:56 user nova-compute[70709]: DEBUG nova.objects.instance [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lazy-loading 'resources' on Instance uuid a585b419-b9f5-4bd6-bbc9-cdfc4e732712 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1549359080',display_name='tempest-ServerStableDeviceRescueTest-server-1549359080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1549359080',id=7,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwy4HneA3ZUmeqPHrbQse+qJUWEhfXTEMPBGDoaqxhrehEEkFn9HOsG11LJXknhyS0mntTrtVk8HXwWH6XqWK8W1vLqidE4n9cl+QqPNrxj8k61BRJMpjdt4hxKUVAzog==',key_name='tempest-keypair-154217269',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:18:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f49049f887a4601b9788b7929269749',ramdisk_id='',reservation_id='r-cg2emlcr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-292119774',owner_user_name='tempest-ServerStableDeviceRescueTest-292119774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4bdf96671af4dcd81161e222a396d2e',uuid=a585b419-b9f5-4bd6-bbc9-cdfc4e732712,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Converting VIF {"id": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "address": "fa:16:3e:03:3a:3b", "network": {"id": "de8b5a09-458a-445c-b0f7-21e454cb5d33", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-52945138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f49049f887a4601b9788b7929269749", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc7a3e-6f", "ovs_interfaceid": "84dc7a3e-6f63-4ff1-8689-38f607df3ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:3a:3b,bridge_name='br-int',has_traffic_filtering=True,id=84dc7a3e-6f63-4ff1-8689-38f607df3ae6,network=Network(de8b5a09-458a-445c-b0f7-21e454cb5d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc7a3e-6f') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG os_vif [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:3a:3b,bridge_name='br-int',has_traffic_filtering=True,id=84dc7a3e-6f63-4ff1-8689-38f607df3ae6,network=Network(de8b5a09-458a-445c-b0f7-21e454cb5d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc7a3e-6f') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84dc7a3e-6f, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:56 user nova-compute[70709]: INFO os_vif [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:3a:3b,bridge_name='br-int',has_traffic_filtering=True,id=84dc7a3e-6f63-4ff1-8689-38f607df3ae6,network=Network(de8b5a09-458a-445c-b0f7-21e454cb5d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc7a3e-6f')
Jul 28 00:21:56 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Deleting instance files /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712_del
Jul 28 00:21:56 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Deletion of /opt/stack/data/nova/instances/a585b419-b9f5-4bd6-bbc9-cdfc4e732712_del complete
Jul 28 00:21:56 user nova-compute[70709]: INFO nova.compute.manager [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 28 00:21:56 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:21:56 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:21:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:21:57 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:21:57 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Took 1.05 seconds to deallocate network for instance.
Jul 28 00:21:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:58 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:21:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-8feeb5d0-f581-46d0-8e83-16402becdda4 req-ec5b79be-475f-45b1-a345-28bfe1af8983 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8feeb5d0-f581-46d0-8e83-16402becdda4 req-ec5b79be-475f-45b1-a345-28bfe1af8983 service nova] Acquiring lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:21:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8feeb5d0-f581-46d0-8e83-16402becdda4 req-ec5b79be-475f-45b1-a345-28bfe1af8983 service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:21:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8feeb5d0-f581-46d0-8e83-16402becdda4 req-ec5b79be-475f-45b1-a345-28bfe1af8983 service nova] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-8feeb5d0-f581-46d0-8e83-16402becdda4 req-ec5b79be-475f-45b1-a345-28bfe1af8983 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] No waiting events found dispatching network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:21:58 user nova-compute[70709]: WARNING nova.compute.manager [req-8feeb5d0-f581-46d0-8e83-16402becdda4 req-ec5b79be-475f-45b1-a345-28bfe1af8983 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received unexpected event network-vif-plugged-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 for instance with vm_state deleted and task_state None.
Jul 28 00:21:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-8feeb5d0-f581-46d0-8e83-16402becdda4 req-ec5b79be-475f-45b1-a345-28bfe1af8983 service nova] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Received event network-vif-deleted-84dc7a3e-6f63-4ff1-8689-38f607df3ae6 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:21:58 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:21:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:21:58 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Deleted allocations for instance a585b419-b9f5-4bd6-bbc9-cdfc4e732712
Jul 28 00:21:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb17ace1-880c-415f-bdc9-65d9555b4e6e tempest-ServerStableDeviceRescueTest-292119774 tempest-ServerStableDeviceRescueTest-292119774-project-member] Lock "a585b419-b9f5-4bd6-bbc9-cdfc4e732712" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.617s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:01 user nova-compute[70709]: DEBUG nova.compute.manager [req-d869857e-c210-424b-a985-7b79e4e7b8ed req-ad9c5db7-21a6-4cf7-ab3f-e29b822cf6e0 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-changed-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:01 user nova-compute[70709]: DEBUG nova.compute.manager [req-d869857e-c210-424b-a985-7b79e4e7b8ed req-ad9c5db7-21a6-4cf7-ab3f-e29b822cf6e0 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Refreshing instance network info cache due to event network-changed-65acb4df-b4f6-4c60-ae40-7c65e73fc335. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:22:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d869857e-c210-424b-a985-7b79e4e7b8ed req-ad9c5db7-21a6-4cf7-ab3f-e29b822cf6e0 service nova] Acquiring lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:22:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d869857e-c210-424b-a985-7b79e4e7b8ed req-ad9c5db7-21a6-4cf7-ab3f-e29b822cf6e0 service nova] Acquired lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:22:01 user nova-compute[70709]: DEBUG nova.network.neutron [req-d869857e-c210-424b-a985-7b79e4e7b8ed req-ad9c5db7-21a6-4cf7-ab3f-e29b822cf6e0 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Refreshing network info cache for port 65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:22:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:02 user nova-compute[70709]: DEBUG nova.network.neutron [req-d869857e-c210-424b-a985-7b79e4e7b8ed req-ad9c5db7-21a6-4cf7-ab3f-e29b822cf6e0 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updated VIF entry in instance network info cache for port 65acb4df-b4f6-4c60-ae40-7c65e73fc335. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:22:02 user nova-compute[70709]: DEBUG nova.network.neutron [req-d869857e-c210-424b-a985-7b79e4e7b8ed req-ad9c5db7-21a6-4cf7-ab3f-e29b822cf6e0 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updating instance_info_cache with network_info: [{"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:22:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d869857e-c210-424b-a985-7b79e4e7b8ed req-ad9c5db7-21a6-4cf7-ab3f-e29b822cf6e0 service nova] Releasing lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:22:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-95d2935e-d55b-46d0-90f5-65f623b7d3e6 req-d21cf081-7463-4fb1-9d45-a4f553ff9068 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-changed-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-95d2935e-d55b-46d0-90f5-65f623b7d3e6 req-d21cf081-7463-4fb1-9d45-a4f553ff9068 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Refreshing instance network info cache due to event network-changed-65acb4df-b4f6-4c60-ae40-7c65e73fc335. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:22:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-95d2935e-d55b-46d0-90f5-65f623b7d3e6 req-d21cf081-7463-4fb1-9d45-a4f553ff9068 service nova] Acquiring lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:22:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-95d2935e-d55b-46d0-90f5-65f623b7d3e6 req-d21cf081-7463-4fb1-9d45-a4f553ff9068 service nova] Acquired lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:22:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-95d2935e-d55b-46d0-90f5-65f623b7d3e6 req-d21cf081-7463-4fb1-9d45-a4f553ff9068 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Refreshing network info cache for port 65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:22:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-95d2935e-d55b-46d0-90f5-65f623b7d3e6 req-d21cf081-7463-4fb1-9d45-a4f553ff9068 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updated VIF entry in instance network info cache for port 65acb4df-b4f6-4c60-ae40-7c65e73fc335. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:22:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-95d2935e-d55b-46d0-90f5-65f623b7d3e6 req-d21cf081-7463-4fb1-9d45-a4f553ff9068 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updating instance_info_cache with network_info: [{"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:22:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-95d2935e-d55b-46d0-90f5-65f623b7d3e6 req-d21cf081-7463-4fb1-9d45-a4f553ff9068 service nova] Releasing lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:22:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:07 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:22:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquired lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:22:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:22:07 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'info_cache' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updating instance_info_cache with network_info: [{"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:22:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Releasing lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:22:07 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance destroyed successfully.
Jul 28 00:22:07 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'resources' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2037149563',display_name='tempest-AttachVolumeTestJSON-server-2037149563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2037149563',id=4,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKNEuPphQPlRnxY0JBcdikh9eshk4/9r69y1/MqVTQrHKGifhAnKKVbTQ0Mknn4VbSSaaRD/uIrFnnbFbmKZbFAB4vCxq+B8edPPxFALUWCcXG/5W4U5PVq8d2KDtyakA==',key_name='tempest-keypair-1576770531',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-2xusewnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=2bb828f4-bb7d-4754-bcaa-38f2954b8eee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG os_vif [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff3e21e0-da, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:08 user nova-compute[70709]: INFO os_vif [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da')
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Start _get_guest_xml network_info=[{"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:08 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:22:08 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2037149563',display_name='tempest-AttachVolumeTestJSON-server-2037149563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2037149563',id=4,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKNEuPphQPlRnxY0JBcdikh9eshk4/9r69y1/MqVTQrHKGifhAnKKVbTQ0Mknn4VbSSaaRD/uIrFnnbFbmKZbFAB4vCxq+B8edPPxFALUWCcXG/5W4U5PVq8d2KDtyakA==',key_name='tempest-keypair-1576770531',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-2xusewnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=2bb828f4-bb7d-4754-bcaa-38f2954b8eee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:22:08 user nova-compute[70709]:   <uuid>2bb828f4-bb7d-4754-bcaa-38f2954b8eee</uuid>
Jul 28 00:22:08 user nova-compute[70709]:   <name>instance-00000004</name>
Jul 28 00:22:08 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:22:08 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:22:08 user nova-compute[70709]:   <metadata>
Jul 28 00:22:08 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:22:08 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:22:08 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeTestJSON-server-2037149563</nova:name>
Jul 28 00:22:08 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:22:08</nova:creationTime>
Jul 28 00:22:08 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:22:08 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:22:08 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:22:08 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:22:08 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:22:08 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:22:08 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:22:08 user nova-compute[70709]:       <nova:owner>
Jul 28 00:22:08 user nova-compute[70709]:         <nova:user uuid="9c3a7c37bbe542008221fd2bcaf18f5c">tempest-AttachVolumeTestJSON-693253624-project-member</nova:user>
Jul 28 00:22:08 user nova-compute[70709]:         <nova:project uuid="7063760e8f3340f88a0505a3cdcdbf7c">tempest-AttachVolumeTestJSON-693253624</nova:project>
Jul 28 00:22:08 user nova-compute[70709]:       </nova:owner>
Jul 28 00:22:08 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:22:08 user nova-compute[70709]:       <nova:ports>
Jul 28 00:22:08 user nova-compute[70709]:         <nova:port uuid="ff3e21e0-da08-4f60-a9fb-e1a4ea572467">
Jul 28 00:22:08 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 28 00:22:08 user nova-compute[70709]:         </nova:port>
Jul 28 00:22:08 user nova-compute[70709]:       </nova:ports>
Jul 28 00:22:08 user nova-compute[70709]:     </nova:instance>
Jul 28 00:22:08 user nova-compute[70709]:   </metadata>
Jul 28 00:22:08 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:22:08 user nova-compute[70709]:     <system>
Jul 28 00:22:08 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:22:08 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:22:08 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:22:08 user nova-compute[70709]:       <entry name="serial">2bb828f4-bb7d-4754-bcaa-38f2954b8eee</entry>
Jul 28 00:22:08 user nova-compute[70709]:       <entry name="uuid">2bb828f4-bb7d-4754-bcaa-38f2954b8eee</entry>
Jul 28 00:22:08 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:22:08 user nova-compute[70709]:     </system>
Jul 28 00:22:08 user nova-compute[70709]:   </sysinfo>
Jul 28 00:22:08 user nova-compute[70709]:   <os>
Jul 28 00:22:08 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:22:08 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:22:08 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:22:08 user nova-compute[70709]:   </os>
Jul 28 00:22:08 user nova-compute[70709]:   <features>
Jul 28 00:22:08 user nova-compute[70709]:     <acpi/>
Jul 28 00:22:08 user nova-compute[70709]:     <apic/>
Jul 28 00:22:08 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:22:08 user nova-compute[70709]:   </features>
Jul 28 00:22:08 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:22:08 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:22:08 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:22:08 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:22:08 user nova-compute[70709]:   </clock>
Jul 28 00:22:08 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:22:08 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:22:08 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:22:08 user nova-compute[70709]:   </cpu>
Jul 28 00:22:08 user nova-compute[70709]:   <devices>
Jul 28 00:22:08 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:22:08 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:22:08 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk"/>
Jul 28 00:22:08 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:22:08 user nova-compute[70709]:     </disk>
Jul 28 00:22:08 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:22:08 user nova-compute[70709]:       <mac address="fa:16:3e:65:2d:ef"/>
Jul 28 00:22:08 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:22:08 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:22:08 user nova-compute[70709]:       <target dev="tapff3e21e0-da"/>
Jul 28 00:22:08 user nova-compute[70709]:     </interface>
Jul 28 00:22:08 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:22:08 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/console.log" append="off"/>
Jul 28 00:22:08 user nova-compute[70709]:     </serial>
Jul 28 00:22:08 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:22:08 user nova-compute[70709]:     <video>
Jul 28 00:22:08 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:22:08 user nova-compute[70709]:     </video>
Jul 28 00:22:08 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:22:08 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:22:08 user nova-compute[70709]:     </rng>
Jul 28 00:22:08 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:22:08 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:22:08 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:22:08 user nova-compute[70709]:     </memballoon>
Jul 28 00:22:08 user nova-compute[70709]:   </devices>
Jul 28 00:22:08 user nova-compute[70709]: </domain>
Jul 28 00:22:08 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:08 user nova-compute[70709]: INFO nova.compute.manager [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Rebooting instance
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquired lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Cannot resize image /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'migration_context' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2037149563',display_name='tempest-AttachVolumeTestJSON-server-2037149563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2037149563',id=4,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKNEuPphQPlRnxY0JBcdikh9eshk4/9r69y1/MqVTQrHKGifhAnKKVbTQ0Mknn4VbSSaaRD/uIrFnnbFbmKZbFAB4vCxq+B8edPPxFALUWCcXG/5W4U5PVq8d2KDtyakA==',key_name='tempest-keypair-1576770531',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-2xusewnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=2bb828f4-bb7d-4754-bcaa-38f2954b8eee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG os_vif [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff3e21e0-da, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff3e21e0-da, col_values=(('external_ids', {'iface-id': 'ff3e21e0-da08-4f60-a9fb-e1a4ea572467', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:2d:ef', 'vm-uuid': '2bb828f4-bb7d-4754-bcaa-38f2954b8eee'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:22:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:08 user nova-compute[70709]: INFO os_vif [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da')
Jul 28 00:22:09 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updating instance_info_cache with network_info: [{"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:22:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Releasing lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:22:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:22:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-730fd91b-98fb-4ae5-8642-5f001bd23297 req-4c9078c0-f762-4463-9cee-169670cc23f5 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-vif-unplugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-730fd91b-98fb-4ae5-8642-5f001bd23297 req-4c9078c0-f762-4463-9cee-169670cc23f5 service nova] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-730fd91b-98fb-4ae5-8642-5f001bd23297 req-4c9078c0-f762-4463-9cee-169670cc23f5 service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-730fd91b-98fb-4ae5-8642-5f001bd23297 req-4c9078c0-f762-4463-9cee-169670cc23f5 service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-730fd91b-98fb-4ae5-8642-5f001bd23297 req-4c9078c0-f762-4463-9cee-169670cc23f5 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] No waiting events found dispatching network-vif-unplugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:09 user nova-compute[70709]: WARNING nova.compute.manager [req-730fd91b-98fb-4ae5-8642-5f001bd23297 req-4c9078c0-f762-4463-9cee-169670cc23f5 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received unexpected event network-vif-unplugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 for instance with vm_state active and task_state reboot_started_hard.
Jul 28 00:22:10 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Instance destroyed successfully.
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'resources' on Instance uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-581496249',display_name='tempest-TestMinimumBasicScenario-server-581496249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-581496249',id=17,image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGInO6F61l2DSAI2ovZyVDChqOqFo0h93AcA8cVc5MY/V3W3srH7250vULELir/NqHmMvUKxg5zkRriaDK8U+Au7OrnO7NCyYUZaahlOg0/rF5B85hTXPJCYAnIp9xleg==',key_name='tempest-TestMinimumBasicScenario-1965300536',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:19:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1de9e1809a584c68905d4c0f42302f8c',ramdisk_id='',reservation_id='r-apa0ef0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1435468286',owner_user_name='tempest-TestMinimumBasicScenario-1435468286-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:22:09Z,user_data=None,user_id='9ed7d89a57234f37b4c578669bce4cdb',uuid=30ac2ae7-04f8-407e-8aee-1c515b61d564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converting VIF {"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_vif [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65acb4df-b4, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:10 user nova-compute[70709]: INFO os_vif [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4')
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBjrhtSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:22:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[55255c5f-c7d6-45e8-be60-b0c0bce6e0fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:22:10 user nova-compute[70709]: No targets found.
Jul 28 00:22:10 user nova-compute[70709]: iSNS:
Jul 28 00:22:10 user nova-compute[70709]: No targets found.
Jul 28 00:22:10 user nova-compute[70709]: STATIC:
Jul 28 00:22:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a
Jul 28 00:22:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860
Jul 28 00:22:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:22:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:22:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d
Jul 28 00:22:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251
Jul 28 00:22:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd
Jul 28 00:22:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:10 user nova-compute[70709]: FIRMWARE:
Jul 28 00:22:10 user nova-compute[70709]: No targets found.
Jul 28 00:22:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:22:10 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:22:10 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d761059-ea86-46a8-8514-769409acc004]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[983f4e54-5007-466a-9bd5-0ba94a74631c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:22:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:10 user nova-compute[70709]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:22:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b906e9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a'): ({'sdc'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Removing single pathed devices sdc {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ecf94d-d223-40ec-a284-a6d608cad03d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b3cb86-6e91-46b2-867c-899b2e5c0269]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Flushing IO for device /dev/sdc {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d96e30de-bae9-4a32-adce-e0aaaceeec39 req-673c0279-627d-4551-9776-4f5f20fe1fc7 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d96e30de-bae9-4a32-adce-e0aaaceeec39 req-673c0279-627d-4551-9776-4f5f20fe1fc7 service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d96e30de-bae9-4a32-adce-e0aaaceeec39 req-673c0279-627d-4551-9776-4f5f20fe1fc7 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d96e30de-bae9-4a32-adce-e0aaaceeec39 req-673c0279-627d-4551-9776-4f5f20fe1fc7 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d96e30de-bae9-4a32-adce-e0aaaceeec39 req-673c0279-627d-4551-9776-4f5f20fe1fc7 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:10 user nova-compute[70709]: WARNING nova.compute.manager [req-d96e30de-bae9-4a32-adce-e0aaaceeec39 req-673c0279-627d-4551-9776-4f5f20fe1fc7 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received unexpected event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with vm_state stopped and task_state powering-on.
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dd0e4d-4166-4bbb-8b7a-dab2332d9d34]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d07fd37-61bc-4060-8eb5-b4e80e388984]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2b6af7-35a9-4542-aaa6-cec0e434bbb1]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[219348d9-efc2-42aa-a782-d94694b3dad6]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260]
Jul 28 00:22:10 user nova-compute[70709]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260] successful.
Jul 28 00:22:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e38dd5-4f6a-4c80-b934-4e54050190f4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] <== disconnect_volume: return (387ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Start _get_guest_xml network_info=[{"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fa772b26-5a84-447b-b1b6-f26fd0dad403,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': 'fa772b26-5a84-447b-b1b6-f26fd0dad403'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'df7c4b86-57a9-44d5-80e0-12888a4c88fb', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBjrhtSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '30ac2ae7-04f8-407e-8aee-1c515b61d564', 'attached_at': '', 'detached_at': '', 'volume_id': '8be09f2b-9c75-4381-8295-df8913d7878a', 'serial': '8be09f2b-9c75-4381-8295-df8913d7878a'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:22:10 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:22:10 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fa772b26-5a84-447b-b1b6-f26fd0dad403,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBjrhtSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:22:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:22:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:22:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:22:10 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:22:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1f82d9-c1a8-459e-91ea-2f07f6034d89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:22:11 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2bbb8f-33a6-4810-9cc2-fb89aea6163a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a] added
Jul 28 00:22:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3a7922-dbea-493f-8bd6-8d6bea2df524]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69bb72d-dee9-4c47-950a-c3cf45c9af0a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBjrhtSN {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBjrhtSN" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d386033-c5d7-4a11-8120-3ef6caf018ee]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GBjrhtSN'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bddb21-c287-4e19-8424-1b957b688c4e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fa36a2-776f-408c-b131-e3be13eea6b9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fd4f35-d60f-424a-90ef-17cb4e62c3af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260]
Jul 28 00:22:11 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260] successful.
Jul 28 00:22:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d435442-5889-49a5-9b66-cc0bdf90e709]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7cc270-5650-4e81-a377-da57564487ba]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:22:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:11 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:22:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e4a5c5-37db-406a-ad24-15218cf7cd8c]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503716.5901647, a585b419-b9f5-4bd6-bbc9-cdfc4e732712 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:22:11 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] VM Stopped (Lifecycle Event)
Jul 28 00:22:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-dd7d0741-e2b3-47d3-ab62-cc6809d33e17 None None] [instance: a585b419-b9f5-4bd6-bbc9-cdfc4e732712] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG nova.compute.manager [req-3f1ea263-1675-47f1-9e8e-9d42911b6b06 req-d25c1f97-3411-4b92-bc62-4825457fecb0 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3f1ea263-1675-47f1-9e8e-9d42911b6b06 req-d25c1f97-3411-4b92-bc62-4825457fecb0 service nova] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3f1ea263-1675-47f1-9e8e-9d42911b6b06 req-d25c1f97-3411-4b92-bc62-4825457fecb0 service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3f1ea263-1675-47f1-9e8e-9d42911b6b06 req-d25c1f97-3411-4b92-bc62-4825457fecb0 service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:11 user nova-compute[70709]: DEBUG nova.compute.manager [req-3f1ea263-1675-47f1-9e8e-9d42911b6b06 req-d25c1f97-3411-4b92-bc62-4825457fecb0 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] No waiting events found dispatching network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:11 user nova-compute[70709]: WARNING nova.compute.manager [req-3f1ea263-1675-47f1-9e8e-9d42911b6b06 req-d25c1f97-3411-4b92-bc62-4825457fecb0 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received unexpected event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 for instance with vm_state active and task_state reboot_started_hard.
Jul 28 00:22:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBjrhtSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26561343838643665', 'path': '/dev/sdc'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561343838643665', 'path': '/dev/sdc'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-581496249',display_name='tempest-TestMinimumBasicScenario-server-581496249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-581496249',id=17,image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGInO6F61l2DSAI2ovZyVDChqOqFo0h93AcA8cVc5MY/V3W3srH7250vULELir/NqHmMvUKxg5zkRriaDK8U+Au7OrnO7NCyYUZaahlOg0/rF5B85hTXPJCYAnIp9xleg==',key_name='tempest-TestMinimumBasicScenario-1965300536',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:19:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1de9e1809a584c68905d4c0f42302f8c',ramdisk_id='',reservation_id='r-apa0ef0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1435468286',owner_user_name='tempest-TestMinimumBasicScenario-1435468286-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:22:09Z,user_data=None,user_id='9ed7d89a57234f37b4c578669bce4cdb',uuid=30ac2ae7-04f8-407e-8aee-1c515b61d564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converting VIF {"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'pci_devices' on Instance uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:22:12 user nova-compute[70709]:   <uuid>30ac2ae7-04f8-407e-8aee-1c515b61d564</uuid>
Jul 28 00:22:12 user nova-compute[70709]:   <name>instance-00000011</name>
Jul 28 00:22:12 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:22:12 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:22:12 user nova-compute[70709]:   <metadata>
Jul 28 00:22:12 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:22:12 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:22:12 user nova-compute[70709]:       <nova:name>tempest-TestMinimumBasicScenario-server-581496249</nova:name>
Jul 28 00:22:12 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:22:10</nova:creationTime>
Jul 28 00:22:12 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:22:12 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:22:12 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:22:12 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:22:12 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:22:12 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:22:12 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:22:12 user nova-compute[70709]:       <nova:owner>
Jul 28 00:22:12 user nova-compute[70709]:         <nova:user uuid="9ed7d89a57234f37b4c578669bce4cdb">tempest-TestMinimumBasicScenario-1435468286-project-member</nova:user>
Jul 28 00:22:12 user nova-compute[70709]:         <nova:project uuid="1de9e1809a584c68905d4c0f42302f8c">tempest-TestMinimumBasicScenario-1435468286</nova:project>
Jul 28 00:22:12 user nova-compute[70709]:       </nova:owner>
Jul 28 00:22:12 user nova-compute[70709]:       <nova:root type="image" uuid="fa772b26-5a84-447b-b1b6-f26fd0dad403"/>
Jul 28 00:22:12 user nova-compute[70709]:       <nova:ports>
Jul 28 00:22:12 user nova-compute[70709]:         <nova:port uuid="65acb4df-b4f6-4c60-ae40-7c65e73fc335">
Jul 28 00:22:12 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 28 00:22:12 user nova-compute[70709]:         </nova:port>
Jul 28 00:22:12 user nova-compute[70709]:       </nova:ports>
Jul 28 00:22:12 user nova-compute[70709]:     </nova:instance>
Jul 28 00:22:12 user nova-compute[70709]:   </metadata>
Jul 28 00:22:12 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:22:12 user nova-compute[70709]:     <system>
Jul 28 00:22:12 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:22:12 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:22:12 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:22:12 user nova-compute[70709]:       <entry name="serial">30ac2ae7-04f8-407e-8aee-1c515b61d564</entry>
Jul 28 00:22:12 user nova-compute[70709]:       <entry name="uuid">30ac2ae7-04f8-407e-8aee-1c515b61d564</entry>
Jul 28 00:22:12 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:22:12 user nova-compute[70709]:     </system>
Jul 28 00:22:12 user nova-compute[70709]:   </sysinfo>
Jul 28 00:22:12 user nova-compute[70709]:   <os>
Jul 28 00:22:12 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:22:12 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:22:12 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:22:12 user nova-compute[70709]:   </os>
Jul 28 00:22:12 user nova-compute[70709]:   <features>
Jul 28 00:22:12 user nova-compute[70709]:     <acpi/>
Jul 28 00:22:12 user nova-compute[70709]:     <apic/>
Jul 28 00:22:12 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:22:12 user nova-compute[70709]:   </features>
Jul 28 00:22:12 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:22:12 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:22:12 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:22:12 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:22:12 user nova-compute[70709]:   </clock>
Jul 28 00:22:12 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:22:12 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:22:12 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:22:12 user nova-compute[70709]:   </cpu>
Jul 28 00:22:12 user nova-compute[70709]:   <devices>
Jul 28 00:22:12 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:22:12 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:22:12 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk"/>
Jul 28 00:22:12 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:22:12 user nova-compute[70709]:     </disk>
Jul 28 00:22:12 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:22:12 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:22:12 user nova-compute[70709]:       <source dev="/dev/sdc"/>
Jul 28 00:22:12 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:22:12 user nova-compute[70709]:       <serial>8be09f2b-9c75-4381-8295-df8913d7878a</serial>
Jul 28 00:22:12 user nova-compute[70709]:     </disk>
Jul 28 00:22:12 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:22:12 user nova-compute[70709]:       <mac address="fa:16:3e:6d:4b:f5"/>
Jul 28 00:22:12 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:22:12 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:22:12 user nova-compute[70709]:       <target dev="tap65acb4df-b4"/>
Jul 28 00:22:12 user nova-compute[70709]:     </interface>
Jul 28 00:22:12 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:22:12 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/console.log" append="off"/>
Jul 28 00:22:12 user nova-compute[70709]:     </serial>
Jul 28 00:22:12 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:22:12 user nova-compute[70709]:     <video>
Jul 28 00:22:12 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:22:12 user nova-compute[70709]:     </video>
Jul 28 00:22:12 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:22:12 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:22:12 user nova-compute[70709]:     </rng>
Jul 28 00:22:12 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:22:12 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:22:12 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:22:12 user nova-compute[70709]:     </memballoon>
Jul 28 00:22:12 user nova-compute[70709]:   </devices>
Jul 28 00:22:12 user nova-compute[70709]: </domain>
Jul 28 00:22:12 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'trusted_certs' on Instance uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503732.679046, 2bb828f4-bb7d-4754-bcaa-38f2954b8eee => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:22:12 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] VM Resumed (Lifecycle Event)
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-9141fe15-6934-49fb-b561-791fc5cdc6b1 req-8b23431a-e25f-4aa1-b04f-42e76a8b155e service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9141fe15-6934-49fb-b561-791fc5cdc6b1 req-8b23431a-e25f-4aa1-b04f-42e76a8b155e service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9141fe15-6934-49fb-b561-791fc5cdc6b1 req-8b23431a-e25f-4aa1-b04f-42e76a8b155e service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9141fe15-6934-49fb-b561-791fc5cdc6b1 req-8b23431a-e25f-4aa1-b04f-42e76a8b155e service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-9141fe15-6934-49fb-b561-791fc5cdc6b1 req-8b23431a-e25f-4aa1-b04f-42e76a8b155e service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:12 user nova-compute[70709]: WARNING nova.compute.manager [req-9141fe15-6934-49fb-b561-791fc5cdc6b1 req-8b23431a-e25f-4aa1-b04f-42e76a8b155e service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received unexpected event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with vm_state stopped and task_state powering-on.
Jul 28 00:22:12 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance rebooted successfully.
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-1f710792-45b2-4d67-aa39-99a72cf36b97 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:22:12 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503732.6812668, 2bb828f4-bb7d-4754-bcaa-38f2954b8eee => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:22:12 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] VM Started (Lifecycle Event)
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:22:12 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2 --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Cannot resize image /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'migration_context' on Instance uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-581496249',display_name='tempest-TestMinimumBasicScenario-server-581496249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-581496249',id=17,image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGInO6F61l2DSAI2ovZyVDChqOqFo0h93AcA8cVc5MY/V3W3srH7250vULELir/NqHmMvUKxg5zkRriaDK8U+Au7OrnO7NCyYUZaahlOg0/rF5B85hTXPJCYAnIp9xleg==',key_name='tempest-TestMinimumBasicScenario-1965300536',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:19:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1de9e1809a584c68905d4c0f42302f8c',ramdisk_id='',reservation_id='r-apa0ef0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1435468286',owner_user_name='tempest-TestMinimumBasicScenario-1435468286-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:22:09Z,user_data=None,user_id='9ed7d89a57234f37b4c578669bce4cdb',uuid=30ac2ae7-04f8-407e-8aee-1c515b61d564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converting VIF {"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG os_vif [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65acb4df-b4, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65acb4df-b4, col_values=(('external_ids', {'iface-id': '65acb4df-b4f6-4c60-ae40-7c65e73fc335', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:4b:f5', 'vm-uuid': '30ac2ae7-04f8-407e-8aee-1c515b61d564'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:13 user nova-compute[70709]: INFO os_vif [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4')
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b3f571eb-b870-4e5c-9d59-f99c2663d3ac req-1762d4cd-fc08-45aa-a41d-cd6ca0787992 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3f571eb-b870-4e5c-9d59-f99c2663d3ac req-1762d4cd-fc08-45aa-a41d-cd6ca0787992 service nova] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3f571eb-b870-4e5c-9d59-f99c2663d3ac req-1762d4cd-fc08-45aa-a41d-cd6ca0787992 service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3f571eb-b870-4e5c-9d59-f99c2663d3ac req-1762d4cd-fc08-45aa-a41d-cd6ca0787992 service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-b3f571eb-b870-4e5c-9d59-f99c2663d3ac req-1762d4cd-fc08-45aa-a41d-cd6ca0787992 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] No waiting events found dispatching network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:14 user nova-compute[70709]: WARNING nova.compute.manager [req-b3f571eb-b870-4e5c-9d59-f99c2663d3ac req-1762d4cd-fc08-45aa-a41d-cd6ca0787992 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received unexpected event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 for instance with vm_state active and task_state reboot_started_hard.
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:22:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:22:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:22:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7157MB free_disk=25.28466796875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance df55bbd3-31ab-42f8-9a71-4ed8e3c4428c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 8168aa39-afce-4c9e-ba76-78a760767357 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance c6297718-d595-4657-aa32-aa75bffdf955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 30ac2ae7-04f8-407e-8aee-1c515b61d564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 3b071a76-32ed-4d72-a3d5-5e4b42bc689c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 75132de4-0252-4bee-bb51-24602cc586ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 552ba43b-6f39-4a9d-a93e-bb2831324d01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance e5fa42c1-2530-48d2-807c-ffbf9b2b355f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-4693c861-44a2-4617-9771-6d8e71a78d15 req-6f9f3a23-4725-4da9-bdbb-6579384cbdab service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4693c861-44a2-4617-9771-6d8e71a78d15 req-6f9f3a23-4725-4da9-bdbb-6579384cbdab service nova] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4693c861-44a2-4617-9771-6d8e71a78d15 req-6f9f3a23-4725-4da9-bdbb-6579384cbdab service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4693c861-44a2-4617-9771-6d8e71a78d15 req-6f9f3a23-4725-4da9-bdbb-6579384cbdab service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-4693c861-44a2-4617-9771-6d8e71a78d15 req-6f9f3a23-4725-4da9-bdbb-6579384cbdab service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] No waiting events found dispatching network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:16 user nova-compute[70709]: WARNING nova.compute.manager [req-4693c861-44a2-4617-9771-6d8e71a78d15 req-6f9f3a23-4725-4da9-bdbb-6579384cbdab service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received unexpected event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 for instance with vm_state active and task_state reboot_started_hard.
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for 30ac2ae7-04f8-407e-8aee-1c515b61d564 due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503736.8346314, 30ac2ae7-04f8-407e-8aee-1c515b61d564 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:22:16 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] VM Resumed (Lifecycle Event)
Jul 28 00:22:16 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Instance rebooted successfully.
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:22:16 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503736.8350372, 30ac2ae7-04f8-407e-8aee-1c515b61d564 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:22:16 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] VM Started (Lifecycle Event)
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b41f9ac6-f380-45d7-8c5c-0b1b0daa3ea3 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.382s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:22:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:22:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:22:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:22:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:22:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:22:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:22:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:22:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:22:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:22:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:22:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:22:18 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:22:18 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:19 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updating instance_info_cache with network_info: [{"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:22:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:22:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:22:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:22:20 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:22:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:22 user nova-compute[70709]: DEBUG nova.compute.manager [req-b743283e-7e11-4a56-b2c3-874c76de9c20 req-458d5dd2-105f-4f15-b12f-2f3983c5eced service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-changed-f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:22 user nova-compute[70709]: DEBUG nova.compute.manager [req-b743283e-7e11-4a56-b2c3-874c76de9c20 req-458d5dd2-105f-4f15-b12f-2f3983c5eced service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing instance network info cache due to event network-changed-f016184b-b548-4b42-ba6d-34dfa078dc0d. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:22:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b743283e-7e11-4a56-b2c3-874c76de9c20 req-458d5dd2-105f-4f15-b12f-2f3983c5eced service nova] Acquiring lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:22:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b743283e-7e11-4a56-b2c3-874c76de9c20 req-458d5dd2-105f-4f15-b12f-2f3983c5eced service nova] Acquired lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:22:22 user nova-compute[70709]: DEBUG nova.network.neutron [req-b743283e-7e11-4a56-b2c3-874c76de9c20 req-458d5dd2-105f-4f15-b12f-2f3983c5eced service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Refreshing network info cache for port f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:22:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:23 user nova-compute[70709]: DEBUG nova.network.neutron [req-b743283e-7e11-4a56-b2c3-874c76de9c20 req-458d5dd2-105f-4f15-b12f-2f3983c5eced service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updated VIF entry in instance network info cache for port f016184b-b548-4b42-ba6d-34dfa078dc0d. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:22:23 user nova-compute[70709]: DEBUG nova.network.neutron [req-b743283e-7e11-4a56-b2c3-874c76de9c20 req-458d5dd2-105f-4f15-b12f-2f3983c5eced service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating instance_info_cache with network_info: [{"id": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "address": "fa:16:3e:a6:f1:19", "network": {"id": "2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1149022988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf016184b-b5", "ovs_interfaceid": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:22:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b743283e-7e11-4a56-b2c3-874c76de9c20 req-458d5dd2-105f-4f15-b12f-2f3983c5eced service nova] Releasing lock "refresh_cache-3b071a76-32ed-4d72-a3d5-5e4b42bc689c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:25 user nova-compute[70709]: INFO nova.compute.manager [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Terminating instance
Jul 28 00:22:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-2d39f797-125b-4ccb-ade7-661659a1ab53 req-57da18b5-5d34-43f9-8a03-2c39869a3656 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2d39f797-125b-4ccb-ade7-661659a1ab53 req-57da18b5-5d34-43f9-8a03-2c39869a3656 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2d39f797-125b-4ccb-ade7-661659a1ab53 req-57da18b5-5d34-43f9-8a03-2c39869a3656 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2d39f797-125b-4ccb-ade7-661659a1ab53 req-57da18b5-5d34-43f9-8a03-2c39869a3656 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-2d39f797-125b-4ccb-ade7-661659a1ab53 req-57da18b5-5d34-43f9-8a03-2c39869a3656 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-unplugged-f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-2d39f797-125b-4ccb-ade7-661659a1ab53 req-57da18b5-5d34-43f9-8a03-2c39869a3656 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-f016184b-b548-4b42-ba6d-34dfa078dc0d for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-7be99a41-8f24-4b05-a0db-df3befc6bbbb req-cab63daf-3b30-461e-b896-af122e319ba0 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-013036a7-b111-4260-b252-7607b25c720a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7be99a41-8f24-4b05-a0db-df3befc6bbbb req-cab63daf-3b30-461e-b896-af122e319ba0 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7be99a41-8f24-4b05-a0db-df3befc6bbbb req-cab63daf-3b30-461e-b896-af122e319ba0 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7be99a41-8f24-4b05-a0db-df3befc6bbbb req-cab63daf-3b30-461e-b896-af122e319ba0 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-7be99a41-8f24-4b05-a0db-df3befc6bbbb req-cab63daf-3b30-461e-b896-af122e319ba0 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-unplugged-013036a7-b111-4260-b252-7607b25c720a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-7be99a41-8f24-4b05-a0db-df3befc6bbbb req-cab63daf-3b30-461e-b896-af122e319ba0 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-013036a7-b111-4260-b252-7607b25c720a for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-2cf99301-3138-4bc9-9f97-f0a77c5b6ea7 req-cdaf87fd-d6e5-4329-a0e0-4e8a38a280f4 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2cf99301-3138-4bc9-9f97-f0a77c5b6ea7 req-cdaf87fd-d6e5-4329-a0e0-4e8a38a280f4 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2cf99301-3138-4bc9-9f97-f0a77c5b6ea7 req-cdaf87fd-d6e5-4329-a0e0-4e8a38a280f4 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2cf99301-3138-4bc9-9f97-f0a77c5b6ea7 req-cdaf87fd-d6e5-4329-a0e0-4e8a38a280f4 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-2cf99301-3138-4bc9-9f97-f0a77c5b6ea7 req-cdaf87fd-d6e5-4329-a0e0-4e8a38a280f4 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-unplugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-2cf99301-3138-4bc9-9f97-f0a77c5b6ea7 req-cdaf87fd-d6e5-4329-a0e0-4e8a38a280f4 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Instance destroyed successfully.
Jul 28 00:22:26 user nova-compute[70709]: DEBUG nova.objects.instance [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lazy-loading 'resources' on Instance uuid 3b071a76-32ed-4d72-a3d5-5e4b42bc689c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "address": "fa:16:3e:a6:f1:19", "network": {"id": "2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1149022988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf016184b-b5", "ovs_interfaceid": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "address": "fa:16:3e:a6:f1:19", "network": {"id": "2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1149022988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf016184b-b5", "ovs_interfaceid": "f016184b-b548-4b42-ba6d-34dfa078dc0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:f1:19,bridge_name='br-int',has_traffic_filtering=True,id=f016184b-b548-4b42-ba6d-34dfa078dc0d,network=Network(2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf016184b-b5') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:f1:19,bridge_name='br-int',has_traffic_filtering=True,id=f016184b-b548-4b42-ba6d-34dfa078dc0d,network=Network(2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf016184b-b5') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf016184b-b5, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: INFO os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:f1:19,bridge_name='br-int',has_traffic_filtering=True,id=f016184b-b548-4b42-ba6d-34dfa078dc0d,network=Network(2e2efb32-c1aa-429a-8b5d-0a9bd8b5d754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf016184b-b5')
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=013036a7-b111-4260-b252-7607b25c720a,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap013036a7-b1') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=013036a7-b111-4260-b252-7607b25c720a,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap013036a7-b1') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap013036a7-b1, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: INFO os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=013036a7-b111-4260-b252-7607b25c720a,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap013036a7-b1')
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:90:0c,bridge_name='br-int',has_traffic_filtering=True,id=a7690ded-3dff-429d-8c20-45ee6ee8f662,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa7690ded-3d') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:90:0c,bridge_name='br-int',has_traffic_filtering=True,id=a7690ded-3dff-429d-8c20-45ee6ee8f662,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa7690ded-3d') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7690ded-3d, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: INFO os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:90:0c,bridge_name='br-int',has_traffic_filtering=True,id=a7690ded-3dff-429d-8c20-45ee6ee8f662,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa7690ded-3d')
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=9d835d57-22e1-4a6a-bccd-97bcd8607cb4,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d835d57-22') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=9d835d57-22e1-4a6a-bccd-97bcd8607cb4,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d835d57-22') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d835d57-22, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: INFO os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=9d835d57-22e1-4a6a-bccd-97bcd8607cb4,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d835d57-22')
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=ff930c20-069f-496d-9883-84907c2eb856,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff930c20-06') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=ff930c20-069f-496d-9883-84907c2eb856,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff930c20-06') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff930c20-06, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: INFO os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=ff930c20-069f-496d-9883-84907c2eb856,network=Network(83826b5e-982d-43ed-95c1-20c657eeb9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff930c20-06')
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:9b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7a7bdc1c-851d-431e-9ca0-f2477e1caf39,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7bdc1c-85') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:9b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7a7bdc1c-851d-431e-9ca0-f2477e1caf39,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7bdc1c-85') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a7bdc1c-85, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: INFO os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:9b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7a7bdc1c-851d-431e-9ca0-f2477e1caf39,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7bdc1c-85')
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-28T00:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-456267461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-456267461',id=18,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqDbm9iT5S/K74ck7imC2bWSq2u3L0yDwfiSgcOpApq/rG3kDUtdLln8gQJ4CquEveelGONbeb2ssDzeIpPBPndqbNHSHgqwSiXPT4dqQDu3Sz3NpF/LYuMBoNoeSodrA==',key_name='tempest-keypair-1447517659',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76e4823ac4f42b9aebf3e9de5b745cf',ramdisk_id='',reservation_id='r-kxnfxe3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1475790778',owner_user_name='tempest-TaggedBootDevicesTest_v242-1475790778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7a795f87ee4e33808e6400d1499b58',uuid=3b071a76-32ed-4d72-a3d5-5e4b42bc689c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converting VIF {"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:29:e7,bridge_name='br-int',has_traffic_filtering=True,id=c4d13f1c-c3f9-4c10-a54f-03a180c736a8,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d13f1c-c3') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:29:e7,bridge_name='br-int',has_traffic_filtering=True,id=c4d13f1c-c3f9-4c10-a54f-03a180c736a8,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d13f1c-c3') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4d13f1c-c3, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:22:27 user nova-compute[70709]: INFO os_vif [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:29:e7,bridge_name='br-int',has_traffic_filtering=True,id=c4d13f1c-c3f9-4c10-a54f-03a180c736a8,network=Network(27442174-87a3-450f-9c27-812bfcbee361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d13f1c-c3')
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBNMKlaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:22:27 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1089118e-cdaf-4b4f-a766-086cf7e831d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:22:27 user nova-compute[70709]: No targets found.
Jul 28 00:22:27 user nova-compute[70709]: iSNS:
Jul 28 00:22:27 user nova-compute[70709]: No targets found.
Jul 28 00:22:27 user nova-compute[70709]: STATIC:
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: FIRMWARE:
Jul 28 00:22:27 user nova-compute[70709]: No targets found.
Jul 28 00:22:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:22:27 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:22:27 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[27564f52-d1fa-4eba-ad3f-e8fe13b933cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6547af0-dc22-4845-bf28-5189f503220c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:22:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:22:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b8875b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251'): ({'sdf'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Removing single pathed devices sdf {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:27 user nova-compute[70709]: WARNING nova.compute.manager [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-f016184b-b548-4b42-ba6d-34dfa078dc0d for instance with vm_state active and task_state deleting.
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-unplugged-ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-ff930c20-069f-496d-9883-84907c2eb856 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:27 user nova-compute[70709]: WARNING nova.compute.manager [req-3496492d-0b84-474f-b132-fd6736a61975 req-f92a95c3-7115-4f8a-a534-8f869508c58a service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-ff930c20-069f-496d-9883-84907c2eb856 for instance with vm_state active and task_state deleting.
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f752ab-204f-43ae-b97f-25d7c93e2e10]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee26b6-2575-48ba-a65b-2a9613dbacbf]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Flushing IO for device /dev/sdf {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d25421-5d73-4cf5-a85d-4a932d9197ba]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e42ca3-c77a-4d00-a0f0-7e54ccaa3e62]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4750fd8b-a6ac-4032-b944-9cf08adbd019]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-013036a7-b111-4260-b252-7607b25c720a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-013036a7-b111-4260-b252-7607b25c720a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:27 user nova-compute[70709]: WARNING nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-013036a7-b111-4260-b252-7607b25c720a for instance with vm_state active and task_state deleting.
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-unplugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:27 user nova-compute[70709]: WARNING nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 for instance with vm_state active and task_state deleting.
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-unplugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:27 user nova-compute[70709]: WARNING nova.compute.manager [req-a230cd1c-e22f-453d-84a3-e098e5c2d97e req-3838f8d2-e974-4e45-ad43-e2a5a7b70095 service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 for instance with vm_state active and task_state deleting.
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5173dfd7-0394-4f61-89e3-2d23ed3a5341]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251, portal: 172.16.0.220,3260]
Jul 28 00:22:27 user nova-compute[70709]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251, portal: 172.16.0.220,3260] successful.
Jul 28 00:22:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16438393-b31a-4090-be62-9f763da2c251 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffd385f-d2fa-402f-9450-63e49b9f12f6]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] <== disconnect_volume: return (340ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPuvQJOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:22:27 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e396f0-58ae-430c-a054-d8ddfcd9d7ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:22:27 user nova-compute[70709]: No targets found.
Jul 28 00:22:27 user nova-compute[70709]: iSNS:
Jul 28 00:22:27 user nova-compute[70709]: No targets found.
Jul 28 00:22:27 user nova-compute[70709]: STATIC:
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd
Jul 28 00:22:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:27 user nova-compute[70709]: FIRMWARE:
Jul 28 00:22:27 user nova-compute[70709]: No targets found.
Jul 28 00:22:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:22:27 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:22:27 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b7d75a-12ab-479b-9170-3e2e25c960e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faf10f4-ae8a-45f8-ba0a-f49aca862554]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:22:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:27 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:22:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b88758ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd'): ({'sde'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Removing single pathed devices sde {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ee5661-98dd-4fce-8395-2c4e517a2a27]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[deae032c-bedb-4966-9811-f823fcb464b0]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Flushing IO for device /dev/sde {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:27 user nova-compute[70709]: WARNING nova.compute.manager [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-a7690ded-3dff-429d-8c20-45ee6ee8f662 for instance with vm_state active and task_state deleting.
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-unplugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-unplugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-plugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] Acquiring lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] No waiting events found dispatching network-vif-plugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:22:27 user nova-compute[70709]: WARNING nova.compute.manager [req-e91d1278-f60a-4177-a82f-2456e5c13186 req-11ef4427-a182-426f-ad00-69ff4037315f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received unexpected event network-vif-plugged-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 for instance with vm_state active and task_state deleting.
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbd7853-62c5-435e-91db-d9657065f403]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67371f1-fcbd-449c-ab36-57bea7257a4d]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed259d9-9307-4eae-98b7-b888e16e375e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cbd7f0-07a6-42a7-a576-8ed36d03d2de]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd, portal: 172.16.0.220,3260]
Jul 28 00:22:28 user nova-compute[70709]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd, portal: 172.16.0.220,3260] successful.
Jul 28 00:22:28 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34011d41-b1dd-4b79-837d-3c574de67abd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a8bd57-4ffd-4b94-a439-08e92f04415e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] <== disconnect_volume: return (347ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CaTuqxSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:22:28 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f7a7db-dcd2-42c2-a0ca-aa6ed044e914]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:22:28 user nova-compute[70709]: No targets found.
Jul 28 00:22:28 user nova-compute[70709]: iSNS:
Jul 28 00:22:28 user nova-compute[70709]: No targets found.
Jul 28 00:22:28 user nova-compute[70709]: STATIC:
Jul 28 00:22:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a
Jul 28 00:22:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860
Jul 28 00:22:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:22:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:22:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:28 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d
Jul 28 00:22:28 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:22:28 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:22:28 user nova-compute[70709]: FIRMWARE:
Jul 28 00:22:28 user nova-compute[70709]: No targets found.
Jul 28 00:22:28 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:22:28 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:22:28 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1453528-3db4-4ff1-8a40-e2e724907420]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e54c3f-8c38-459f-8a11-ec266eaba6fc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:28 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:28 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:28 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:28 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:22:28 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:22:28 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:22:28 user nova-compute[70709]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d (non-flash)
Jul 28 00:22:28 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:22:28 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:22:28 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90191000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d'): ({'sdg'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Removing single pathed devices sdg {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbdc8ec-3ecf-4e1e-876c-83a69e85542f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8911a8c5-c632-44e7-87cf-eac9dfeff4a2]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Flushing IO for device /dev/sdg {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[141ff294-dd7a-47c1-a294-78a146f60260]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e96584-d95f-4e4c-a63a-9550ebdd8b81]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] SCSI volumes sdg have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18c3d43-fd26-4146-9dd6-7b42e9a9d432]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26fc3e4-af62-468a-9a61-2128ed57e1da]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d, portal: 172.16.0.220,3260]
Jul 28 00:22:28 user nova-compute[70709]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d, portal: 172.16.0.220,3260] successful.
Jul 28 00:22:28 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d456834c-e70e-4daf-be6c-6e4d1870048d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[da06c874-feff-4c74-9d29-4098240c4487]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] <== disconnect_volume: return (306ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:22:28 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Deleting instance files /opt/stack/data/nova/instances/3b071a76-32ed-4d72-a3d5-5e4b42bc689c_del
Jul 28 00:22:28 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Deletion of /opt/stack/data/nova/instances/3b071a76-32ed-4d72-a3d5-5e4b42bc689c_del complete
Jul 28 00:22:28 user nova-compute[70709]: INFO nova.compute.manager [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Took 3.39 seconds to destroy the instance on the hypervisor.
Jul 28 00:22:28 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:22:28 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:22:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-033e30ff-3639-415a-acdc-1999161605a0 req-7ada4588-9755-4e22-8ed9-09cc72d947cb service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-deleted-f016184b-b548-4b42-ba6d-34dfa078dc0d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:30 user nova-compute[70709]: INFO nova.compute.manager [req-033e30ff-3639-415a-acdc-1999161605a0 req-7ada4588-9755-4e22-8ed9-09cc72d947cb service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Neutron deleted interface f016184b-b548-4b42-ba6d-34dfa078dc0d; detaching it from the instance and deleting it from the info cache
Jul 28 00:22:30 user nova-compute[70709]: DEBUG nova.network.neutron [req-033e30ff-3639-415a-acdc-1999161605a0 req-7ada4588-9755-4e22-8ed9-09cc72d947cb service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating instance_info_cache with network_info: [{"id": "013036a7-b111-4260-b252-7607b25c720a", "address": "fa:16:3e:b1:e8:6c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap013036a7-b1", "ovs_interfaceid": "013036a7-b111-4260-b252-7607b25c720a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "address": "fa:16:3e:fd:90:0c", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7690ded-3d", "ovs_interfaceid": "a7690ded-3dff-429d-8c20-45ee6ee8f662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "address": "fa:16:3e:9e:54:c7", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d835d57-22", "ovs_interfaceid": "9d835d57-22e1-4a6a-bccd-97bcd8607cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff930c20-069f-496d-9883-84907c2eb856", "address": "fa:16:3e:5b:ac:be", "network": {"id": "83826b5e-982d-43ed-95c1-20c657eeb9f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-858107087", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff930c20-06", "ovs_interfaceid": "ff930c20-069f-496d-9883-84907c2eb856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "address": "fa:16:3e:91:9b:3b", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7bdc1c-85", "ovs_interfaceid": "7a7bdc1c-851d-431e-9ca0-f2477e1caf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "address": "fa:16:3e:78:29:e7", "network": {"id": "27442174-87a3-450f-9c27-812bfcbee361", "bridge": "br-int", "label": "tempest-device-tagging-net2-279386211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f76e4823ac4f42b9aebf3e9de5b745cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d13f1c-c3", "ovs_interfaceid": "c4d13f1c-c3f9-4c10-a54f-03a180c736a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:22:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-033e30ff-3639-415a-acdc-1999161605a0 req-7ada4588-9755-4e22-8ed9-09cc72d947cb service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Detach interface failed, port_id=f016184b-b548-4b42-ba6d-34dfa078dc0d, reason: Instance 3b071a76-32ed-4d72-a3d5-5e4b42bc689c could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:22:31 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:22:31 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Took 3.47 seconds to deallocate network for instance.
Jul 28 00:22:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-67515e68-37b1-4cd3-8f9b-a883d8da7743 req-1215711e-8a76-41f9-977b-8e9086a9538f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-deleted-7a7bdc1c-851d-431e-9ca0-f2477e1caf39 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-67515e68-37b1-4cd3-8f9b-a883d8da7743 req-1215711e-8a76-41f9-977b-8e9086a9538f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-deleted-ff930c20-069f-496d-9883-84907c2eb856 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-67515e68-37b1-4cd3-8f9b-a883d8da7743 req-1215711e-8a76-41f9-977b-8e9086a9538f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-deleted-c4d13f1c-c3f9-4c10-a54f-03a180c736a8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-67515e68-37b1-4cd3-8f9b-a883d8da7743 req-1215711e-8a76-41f9-977b-8e9086a9538f service nova] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Received event network-vif-deleted-9d835d57-22e1-4a6a-bccd-97bcd8607cb4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:35 user nova-compute[70709]: INFO nova.compute.manager [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Took 3.31 seconds to detach 3 volumes for instance.
Jul 28 00:22:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:35 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:22:35 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:22:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:35 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Deleted allocations for instance 3b071a76-32ed-4d72-a3d5-5e4b42bc689c
Jul 28 00:22:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cf5da890-731b-4c3c-9246-ed5b26a14297 tempest-TaggedBootDevicesTest_v242-1475790778 tempest-TaggedBootDevicesTest_v242-1475790778-project-member] Lock "3b071a76-32ed-4d72-a3d5-5e4b42bc689c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.748s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:22:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:41 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503746.9083562, 3b071a76-32ed-4d72-a3d5-5e4b42bc689c => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:22:41 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] VM Stopped (Lifecycle Event)
Jul 28 00:22:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e5cda7d8-904f-4b04-816e-b41be92eee59 None None] [instance: 3b071a76-32ed-4d72-a3d5-5e4b42bc689c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:22:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:22:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:22:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-3dbd1545-7989-4a4a-a25d-df727f6856f4 req-4f5c8172-5c18-4441-b304-e1deac510fda service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Received event network-changed-96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:22:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-3dbd1545-7989-4a4a-a25d-df727f6856f4 req-4f5c8172-5c18-4441-b304-e1deac510fda service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Refreshing instance network info cache due to event network-changed-96ca7876-737c-4df3-ac1b-c778b5daae59. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:22:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3dbd1545-7989-4a4a-a25d-df727f6856f4 req-4f5c8172-5c18-4441-b304-e1deac510fda service nova] Acquiring lock "refresh_cache-75132de4-0252-4bee-bb51-24602cc586ba" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:22:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3dbd1545-7989-4a4a-a25d-df727f6856f4 req-4f5c8172-5c18-4441-b304-e1deac510fda service nova] Acquired lock "refresh_cache-75132de4-0252-4bee-bb51-24602cc586ba" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:22:58 user nova-compute[70709]: DEBUG nova.network.neutron [req-3dbd1545-7989-4a4a-a25d-df727f6856f4 req-4f5c8172-5c18-4441-b304-e1deac510fda service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Refreshing network info cache for port 96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:22:59 user nova-compute[70709]: DEBUG nova.network.neutron [req-3dbd1545-7989-4a4a-a25d-df727f6856f4 req-4f5c8172-5c18-4441-b304-e1deac510fda service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Updated VIF entry in instance network info cache for port 96ca7876-737c-4df3-ac1b-c778b5daae59. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:22:59 user nova-compute[70709]: DEBUG nova.network.neutron [req-3dbd1545-7989-4a4a-a25d-df727f6856f4 req-4f5c8172-5c18-4441-b304-e1deac510fda service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Updating instance_info_cache with network_info: [{"id": "96ca7876-737c-4df3-ac1b-c778b5daae59", "address": "fa:16:3e:de:67:06", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ca7876-73", "ovs_interfaceid": "96ca7876-737c-4df3-ac1b-c778b5daae59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:22:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3dbd1545-7989-4a4a-a25d-df727f6856f4 req-4f5c8172-5c18-4441-b304-e1deac510fda service nova] Releasing lock "refresh_cache-75132de4-0252-4bee-bb51-24602cc586ba" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:22:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:22:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:22:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:22:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:22:59 user nova-compute[70709]: INFO nova.compute.claims [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Claim successful on node user
Jul 28 00:23:00 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:23:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:23:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG nova.policy [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa22ce59fc4742d4ab16292a8b3d6e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6929fa5cb2284dd8b94c387bf6e3fef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:23:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Creating image(s)
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "/opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "/opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.170s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.153s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk 1073741824" returned: 0 in 0.059s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:00 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Successfully created port: 4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Cannot resize image /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'migration_context' on Instance uuid 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Ensure instance console log exists: /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "75132de4-0252-4bee-bb51-24602cc586ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG nova.objects.instance [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'flavor' on Instance uuid 75132de4-0252-4bee-bb51-24602cc586ba {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Successfully updated port: 4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "refresh_cache-1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquired lock "refresh_cache-1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-1fb9ceea-ffe7-4bac-9585-d2c9b0ee95bd req-17b33d8c-5c74-468f-82eb-d9dbe439675c service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Received event network-changed-4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-1fb9ceea-ffe7-4bac-9585-d2c9b0ee95bd req-17b33d8c-5c74-468f-82eb-d9dbe439675c service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Refreshing instance network info cache due to event network-changed-4589f8aa-273e-4eef-8506-98fa4d45e56d. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1fb9ceea-ffe7-4bac-9585-d2c9b0ee95bd req-17b33d8c-5c74-468f-82eb-d9dbe439675c service nova] Acquiring lock "refresh_cache-1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "75132de4-0252-4bee-bb51-24602cc586ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:02 user nova-compute[70709]: INFO nova.compute.manager [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Attaching volume 49dd8679-b3c1-4907-9fb3-3d0b795d16c2 to /dev/vdb
Jul 28 00:23:02 user nova-compute[70709]: DEBUG os_brick.utils [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd036490-5cd1-45be-897a-1a604234b7a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7bced2-60da-49ae-b2d1-3d159520722b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[175791d6-f70a-4d60-9651-f76481a6e456]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a52c2f5-c979-4a21-8761-73aac124011b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:23:02 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c07f7c-a482-4e3f-b8db-6f44733cbeab]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG os_brick.utils [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Updating existing volume attachment record: 1bb166e6-9ddf-458f-ab50-8ee615d2c359 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Updating instance_info_cache with network_info: [{"id": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "address": "fa:16:3e:be:80:57", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4589f8aa-27", "ovs_interfaceid": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Releasing lock "refresh_cache-1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Instance network_info: |[{"id": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "address": "fa:16:3e:be:80:57", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4589f8aa-27", "ovs_interfaceid": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1fb9ceea-ffe7-4bac-9585-d2c9b0ee95bd req-17b33d8c-5c74-468f-82eb-d9dbe439675c service nova] Acquired lock "refresh_cache-1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.neutron [req-1fb9ceea-ffe7-4bac-9585-d2c9b0ee95bd req-17b33d8c-5c74-468f-82eb-d9dbe439675c service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Refreshing network info cache for port 4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Start _get_guest_xml network_info=[{"id": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "address": "fa:16:3e:be:80:57", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4589f8aa-27", "ovs_interfaceid": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:23:02 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:23:02 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-197400054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-197400054',id=22,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-p4qw9gn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:23:00Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "address": "fa:16:3e:be:80:57", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4589f8aa-27", "ovs_interfaceid": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "address": "fa:16:3e:be:80:57", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4589f8aa-27", "ovs_interfaceid": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:80:57,bridge_name='br-int',has_traffic_filtering=True,id=4589f8aa-273e-4eef-8506-98fa4d45e56d,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4589f8aa-27') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:23:02 user nova-compute[70709]:   <uuid>1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf</uuid>
Jul 28 00:23:02 user nova-compute[70709]:   <name>instance-00000016</name>
Jul 28 00:23:02 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:23:02 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:23:02 user nova-compute[70709]:   <metadata>
Jul 28 00:23:02 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:23:02 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:23:02 user nova-compute[70709]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-197400054</nova:name>
Jul 28 00:23:02 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:23:02</nova:creationTime>
Jul 28 00:23:02 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:23:02 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:23:02 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:23:02 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:23:02 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:23:02 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:23:02 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:23:02 user nova-compute[70709]:       <nova:owner>
Jul 28 00:23:02 user nova-compute[70709]:         <nova:user uuid="fa22ce59fc4742d4ab16292a8b3d6e3f">tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member</nova:user>
Jul 28 00:23:02 user nova-compute[70709]:         <nova:project uuid="6929fa5cb2284dd8b94c387bf6e3fef6">tempest-ServerBootFromVolumeStableRescueTest-2075329923</nova:project>
Jul 28 00:23:02 user nova-compute[70709]:       </nova:owner>
Jul 28 00:23:02 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:23:02 user nova-compute[70709]:       <nova:ports>
Jul 28 00:23:02 user nova-compute[70709]:         <nova:port uuid="4589f8aa-273e-4eef-8506-98fa4d45e56d">
Jul 28 00:23:02 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 28 00:23:02 user nova-compute[70709]:         </nova:port>
Jul 28 00:23:02 user nova-compute[70709]:       </nova:ports>
Jul 28 00:23:02 user nova-compute[70709]:     </nova:instance>
Jul 28 00:23:02 user nova-compute[70709]:   </metadata>
Jul 28 00:23:02 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:23:02 user nova-compute[70709]:     <system>
Jul 28 00:23:02 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:23:02 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:23:02 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:23:02 user nova-compute[70709]:       <entry name="serial">1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf</entry>
Jul 28 00:23:02 user nova-compute[70709]:       <entry name="uuid">1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf</entry>
Jul 28 00:23:02 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:23:02 user nova-compute[70709]:     </system>
Jul 28 00:23:02 user nova-compute[70709]:   </sysinfo>
Jul 28 00:23:02 user nova-compute[70709]:   <os>
Jul 28 00:23:02 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:23:02 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:23:02 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:23:02 user nova-compute[70709]:   </os>
Jul 28 00:23:02 user nova-compute[70709]:   <features>
Jul 28 00:23:02 user nova-compute[70709]:     <acpi/>
Jul 28 00:23:02 user nova-compute[70709]:     <apic/>
Jul 28 00:23:02 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:23:02 user nova-compute[70709]:   </features>
Jul 28 00:23:02 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:23:02 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:23:02 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:23:02 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:23:02 user nova-compute[70709]:   </clock>
Jul 28 00:23:02 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:23:02 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:23:02 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:23:02 user nova-compute[70709]:   </cpu>
Jul 28 00:23:02 user nova-compute[70709]:   <devices>
Jul 28 00:23:02 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:23:02 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:23:02 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk"/>
Jul 28 00:23:02 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:23:02 user nova-compute[70709]:     </disk>
Jul 28 00:23:02 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:23:02 user nova-compute[70709]:       <mac address="fa:16:3e:be:80:57"/>
Jul 28 00:23:02 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:23:02 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:23:02 user nova-compute[70709]:       <target dev="tap4589f8aa-27"/>
Jul 28 00:23:02 user nova-compute[70709]:     </interface>
Jul 28 00:23:02 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:23:02 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/console.log" append="off"/>
Jul 28 00:23:02 user nova-compute[70709]:     </serial>
Jul 28 00:23:02 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:23:02 user nova-compute[70709]:     <video>
Jul 28 00:23:02 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:23:02 user nova-compute[70709]:     </video>
Jul 28 00:23:02 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:23:02 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:23:02 user nova-compute[70709]:     </rng>
Jul 28 00:23:02 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:23:02 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:23:02 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:23:02 user nova-compute[70709]:     </memballoon>
Jul 28 00:23:02 user nova-compute[70709]:   </devices>
Jul 28 00:23:02 user nova-compute[70709]: </domain>
Jul 28 00:23:02 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-197400054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-197400054',id=22,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-p4qw9gn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:23:00Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "address": "fa:16:3e:be:80:57", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4589f8aa-27", "ovs_interfaceid": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "address": "fa:16:3e:be:80:57", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4589f8aa-27", "ovs_interfaceid": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:80:57,bridge_name='br-int',has_traffic_filtering=True,id=4589f8aa-273e-4eef-8506-98fa4d45e56d,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4589f8aa-27') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG os_vif [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:80:57,bridge_name='br-int',has_traffic_filtering=True,id=4589f8aa-273e-4eef-8506-98fa4d45e56d,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4589f8aa-27') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4589f8aa-27, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4589f8aa-27, col_values=(('external_ids', {'iface-id': '4589f8aa-273e-4eef-8506-98fa4d45e56d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:80:57', 'vm-uuid': '1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:02 user nova-compute[70709]: INFO os_vif [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:80:57,bridge_name='br-int',has_traffic_filtering=True,id=4589f8aa-273e-4eef-8506-98fa4d45e56d,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4589f8aa-27')
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No VIF found with MAC fa:16:3e:be:80:57, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-3cf03cb9-32d0-4844-bd03-be489b3ad6b5 req-5da98821-b0bb-42ff-87ef-e18d6c4ab042 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-changed-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-3cf03cb9-32d0-4844-bd03-be489b3ad6b5 req-5da98821-b0bb-42ff-87ef-e18d6c4ab042 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Refreshing instance network info cache due to event network-changed-3bf19206-8843-4662-a147-edec46431a9b. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3cf03cb9-32d0-4844-bd03-be489b3ad6b5 req-5da98821-b0bb-42ff-87ef-e18d6c4ab042 service nova] Acquiring lock "refresh_cache-552ba43b-6f39-4a9d-a93e-bb2831324d01" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3cf03cb9-32d0-4844-bd03-be489b3ad6b5 req-5da98821-b0bb-42ff-87ef-e18d6c4ab042 service nova] Acquired lock "refresh_cache-552ba43b-6f39-4a9d-a93e-bb2831324d01" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.neutron [req-3cf03cb9-32d0-4844-bd03-be489b3ad6b5 req-5da98821-b0bb-42ff-87ef-e18d6c4ab042 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Refreshing network info cache for port 3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.neutron [req-1fb9ceea-ffe7-4bac-9585-d2c9b0ee95bd req-17b33d8c-5c74-468f-82eb-d9dbe439675c service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Updated VIF entry in instance network info cache for port 4589f8aa-273e-4eef-8506-98fa4d45e56d. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG nova.network.neutron [req-1fb9ceea-ffe7-4bac-9585-d2c9b0ee95bd req-17b33d8c-5c74-468f-82eb-d9dbe439675c service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Updating instance_info_cache with network_info: [{"id": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "address": "fa:16:3e:be:80:57", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4589f8aa-27", "ovs_interfaceid": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:23:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1fb9ceea-ffe7-4bac-9585-d2c9b0ee95bd req-17b33d8c-5c74-468f-82eb-d9dbe439675c service nova] Releasing lock "refresh_cache-1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:23:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-3cf03cb9-32d0-4844-bd03-be489b3ad6b5 req-5da98821-b0bb-42ff-87ef-e18d6c4ab042 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Updated VIF entry in instance network info cache for port 3bf19206-8843-4662-a147-edec46431a9b. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:23:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-3cf03cb9-32d0-4844-bd03-be489b3ad6b5 req-5da98821-b0bb-42ff-87ef-e18d6c4ab042 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Updating instance_info_cache with network_info: [{"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:23:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3cf03cb9-32d0-4844-bd03-be489b3ad6b5 req-5da98821-b0bb-42ff-87ef-e18d6c4ab042 service nova] Releasing lock "refresh_cache-552ba43b-6f39-4a9d-a93e-bb2831324d01" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:23:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:03 user nova-compute[70709]: INFO nova.compute.manager [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Rebuilding instance
Jul 28 00:23:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lazy-loading 'trusted_certs' on Instance uuid 552ba43b-6f39-4a9d-a93e-bb2831324d01 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lazy-loading 'pci_requests' on Instance uuid 552ba43b-6f39-4a9d-a93e-bb2831324d01 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lazy-loading 'pci_devices' on Instance uuid 552ba43b-6f39-4a9d-a93e-bb2831324d01 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lazy-loading 'resources' on Instance uuid 552ba43b-6f39-4a9d-a93e-bb2831324d01 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lazy-loading 'migration_context' on Instance uuid 552ba43b-6f39-4a9d-a93e-bb2831324d01 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70709) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-27213008-25de-4bae-9eb9-d20e831e6df4 req-3b9081be-2c54-4b0c-aa51-4d24c0f92e13 service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Received event network-vif-plugged-4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-27213008-25de-4bae-9eb9-d20e831e6df4 req-3b9081be-2c54-4b0c-aa51-4d24c0f92e13 service nova] Acquiring lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-27213008-25de-4bae-9eb9-d20e831e6df4 req-3b9081be-2c54-4b0c-aa51-4d24c0f92e13 service nova] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-27213008-25de-4bae-9eb9-d20e831e6df4 req-3b9081be-2c54-4b0c-aa51-4d24c0f92e13 service nova] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-27213008-25de-4bae-9eb9-d20e831e6df4 req-3b9081be-2c54-4b0c-aa51-4d24c0f92e13 service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] No waiting events found dispatching network-vif-plugged-4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:04 user nova-compute[70709]: WARNING nova.compute.manager [req-27213008-25de-4bae-9eb9-d20e831e6df4 req-3b9081be-2c54-4b0c-aa51-4d24c0f92e13 service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Received unexpected event network-vif-plugged-4589f8aa-273e-4eef-8506-98fa4d45e56d for instance with vm_state building and task_state spawning.
Jul 28 00:23:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-vif-unplugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] No waiting events found dispatching network-vif-unplugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:04 user nova-compute[70709]: WARNING nova.compute.manager [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received unexpected event network-vif-unplugged-3bf19206-8843-4662-a147-edec46431a9b for instance with vm_state active and task_state rebuilding.
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] No waiting events found dispatching network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:04 user nova-compute[70709]: WARNING nova.compute.manager [req-40dec352-0bc9-4892-8998-cfea280132a1 req-5805551b-839c-40a8-b1c9-6c381a92a583 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received unexpected event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b for instance with vm_state active and task_state rebuilding.
Jul 28 00:23:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Instance destroyed successfully.
Jul 28 00:23:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Instance destroyed successfully.
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-260409921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1150596554',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTphqF5bcF3n3OoMRDgsPxmVaUYJwZyxO441ggHQIolrfJ5FpS+UvFhc6UHNKt8wYOsoG6vj9jSalQ6YygK6u0e05rHRBkpcdU+YG6jEUzfArQfV3iGatSOnUZeh6becA==',key_name='tempest-keypair-382930470',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='526ce0f27cc343a5ac86331ee21076ec',ramdisk_id='',reservation_id='r-i95b6tf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1273279077',owner_user_name='tempest-ServerActionsV293TestJSON-1273279077-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:23:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b436a6349354f97a81ea3977aec28a5',uuid=552ba43b-6f39-4a9d-a93e-bb2831324d01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converting VIF {"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG os_vif [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bf19206-88, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:23:04 user nova-compute[70709]: INFO os_vif [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88')
Jul 28 00:23:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTJaFlYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:23:04 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 28 00:23:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bbcbf9-863c-45c4-82f8-0850341ef316]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:23:04 user nova-compute[70709]: No targets found.
Jul 28 00:23:04 user nova-compute[70709]: iSNS:
Jul 28 00:23:04 user nova-compute[70709]: No targets found.
Jul 28 00:23:04 user nova-compute[70709]: STATIC:
Jul 28 00:23:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a
Jul 28 00:23:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860
Jul 28 00:23:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:23:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:23:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:04 user nova-compute[70709]: FIRMWARE:
Jul 28 00:23:04 user nova-compute[70709]: No targets found.
Jul 28 00:23:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:23:04 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:23:04 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:23:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d8a488-ed12-405b-bffd-93ee28817ddb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dd99fa-0b55-4229-a1fd-3378620e532c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:05 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:23:05 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:23:05 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:05 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:23:05 user nova-compute[70709]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:23:05 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90258280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860'): ({'sdh'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Removing single pathed devices sdh {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[28676311-a7b8-446a-be0f-612e0e5c08cb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b8b279-cdaa-43ff-bf5b-44238866f200]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Flushing IO for device /dev/sdh {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d087f85a-21ac-4a4d-97ba-a689e5bbd0b6]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e8d028-17e8-4abf-bc10-0400aeea1809]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] SCSI volumes sdh have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea9e7b7-1bc6-44da-9cf0-1eb5138c2f79]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e542d9-376a-4072-a07c-91be726ffee5]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260]
Jul 28 00:23:05 user nova-compute[70709]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260] successful.
Jul 28 00:23:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4144e92a-b2ed-4d00-8aa1-2ee41af04a97]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] <== disconnect_volume: return (344ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:23:05 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Deleting instance files /opt/stack/data/nova/instances/552ba43b-6f39-4a9d-a93e-bb2831324d01_del
Jul 28 00:23:05 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Deletion of /opt/stack/data/nova/instances/552ba43b-6f39-4a9d-a93e-bb2831324d01_del complete
Jul 28 00:23:05 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 552ba43b-6f39-4a9d-a93e-bb2831324d01 could not be found.
Jul 28 00:23:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTJaFlYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:23:05 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e05db70-7951-47cc-b9ea-18e49622ff8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:23:05 user nova-compute[70709]: No targets found.
Jul 28 00:23:05 user nova-compute[70709]: iSNS:
Jul 28 00:23:05 user nova-compute[70709]: No targets found.
Jul 28 00:23:05 user nova-compute[70709]: STATIC:
Jul 28 00:23:05 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a
Jul 28 00:23:05 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:05 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:05 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:23:05 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:05 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:05 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:23:05 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:05 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:05 user nova-compute[70709]: FIRMWARE:
Jul 28 00:23:05 user nova-compute[70709]: No targets found.
Jul 28 00:23:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:23:05 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:23:05 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1534f73b-3ed8-4161-85e9-14bf35973cd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1722b953-f581-4349-8efd-b39e19d00c76]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:05 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:23:05 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:05 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:23:05 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b9d0ba4d0>, {}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Disconnecting from: [] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] <== disconnect_volume: return (72ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:23:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503786.158937, 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:23:06 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] VM Resumed (Lifecycle Event)
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:23:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Instance spawned successfully.
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:06 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503786.162273, 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:23:06 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] VM Started (Lifecycle Event)
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:23:06 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:23:06 user nova-compute[70709]: INFO nova.compute.manager [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Took 5.93 seconds to spawn the instance on the hypervisor.
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-640975e1-e6ad-4e86-9a19-c5fe930dbea7 req-e1023a12-8306-4b1b-bb1e-7acd2fd20e16 service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Received event network-vif-plugged-4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-640975e1-e6ad-4e86-9a19-c5fe930dbea7 req-e1023a12-8306-4b1b-bb1e-7acd2fd20e16 service nova] Acquiring lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-640975e1-e6ad-4e86-9a19-c5fe930dbea7 req-e1023a12-8306-4b1b-bb1e-7acd2fd20e16 service nova] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-640975e1-e6ad-4e86-9a19-c5fe930dbea7 req-e1023a12-8306-4b1b-bb1e-7acd2fd20e16 service nova] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-640975e1-e6ad-4e86-9a19-c5fe930dbea7 req-e1023a12-8306-4b1b-bb1e-7acd2fd20e16 service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] No waiting events found dispatching network-vif-plugged-4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:06 user nova-compute[70709]: WARNING nova.compute.manager [req-640975e1-e6ad-4e86-9a19-c5fe930dbea7 req-e1023a12-8306-4b1b-bb1e-7acd2fd20e16 service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Received unexpected event network-vif-plugged-4589f8aa-273e-4eef-8506-98fa4d45e56d for instance with vm_state building and task_state spawning.
Jul 28 00:23:06 user nova-compute[70709]: INFO nova.compute.manager [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Took 6.77 seconds to build instance.
Jul 28 00:23:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b000e450-b65b-4f86-abfc-cfb1b495e0d9 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.878s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Preparing to wait for external event volume-reimaged-57830a9a-041e-4dc0-b2e7-ae09961e9860 {{(pid=70709) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:09 user nova-compute[70709]: INFO nova.compute.manager [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Terminating instance
Jul 28 00:23:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-6fde06bd-2a71-48d0-961e-8e4b8a61f334 req-da175acd-7eb6-47cf-8181-97b075772c6b service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-unplugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6fde06bd-2a71-48d0-961e-8e4b8a61f334 req-da175acd-7eb6-47cf-8181-97b075772c6b service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6fde06bd-2a71-48d0-961e-8e4b8a61f334 req-da175acd-7eb6-47cf-8181-97b075772c6b service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6fde06bd-2a71-48d0-961e-8e4b8a61f334 req-da175acd-7eb6-47cf-8181-97b075772c6b service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-6fde06bd-2a71-48d0-961e-8e4b8a61f334 req-da175acd-7eb6-47cf-8181-97b075772c6b service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-unplugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-6fde06bd-2a71-48d0-961e-8e4b8a61f334 req-da175acd-7eb6-47cf-8181-97b075772c6b service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-unplugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwSNfhYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:23:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:23:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:23:10 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e65554c-42ed-407c-a2e5-db56d606f397]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:23:10 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebe93e4-91b4-4a2e-8af7-c594d08f88d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2] added
Jul 28 00:23:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e840f1-c578-47fb-8124-e782cc46b931]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e59db7-4aed-4278-9c9f-8d16467a15ee]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwSNfhYT {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwSNfhYT" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87def02-3e5e-46a7-953b-1afa729ecf84]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zwSNfhYT'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9a33b0-6af7-4b21-a7d3-f5eac47f1ada]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[17be2f94-bf20-4ade-9f03-1353fe97869e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:10 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:23:10 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:10 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:23:10 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce7e4e7-a652-4794-b6db-4fb29dc1bcdf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2, portal: 172.16.0.220,3260]
Jul 28 00:23:10 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2, portal: 172.16.0.220,3260] successful.
Jul 28 00:23:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[38572ef1-bf15-4c8d-a7f9-fee7f17c9eb3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:10 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Instance destroyed successfully.
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lazy-loading 'resources' on Instance uuid df55bbd3-31ab-42f8-9a71-4ed8e3c4428c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1488928010',display_name='tempest-ServerActionsTestOtherB-server-1488928010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1488928010',id=3,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnNPKIDRaM81k628x28KRrACS+k9io0IYMr8rKnbfV6R9PEGedJ0uPueig7JixSq/MVd5cruSs8PGo9MLWndddj6j9yk5HzD1hsNyADvhHRJFhgOMMfk3L2UUGGtvzDbA==',key_name='tempest-keypair-458737518',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:20:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8a7ed8f269b4e989727baa24619d774',ramdisk_id='',reservation_id='r-0vm06iql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1900188209',owner_user_name='tempest-ServerActionsTestOtherB-1900188209-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:20:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc9412c0c5a345399b7cc2ff4540535d',uuid=df55bbd3-31ab-42f8-9a71-4ed8e3c4428c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converting VIF {"id": "7e92340f-f93d-411f-8e69-2a75164b3679", "address": "fa:16:3e:58:0f:bc", "network": {"id": "02f93a99-911e-4a23-b3dc-8836139ed1bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1008293406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a7ed8f269b4e989727baa24619d774", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e92340f-f9", "ovs_interfaceid": "7e92340f-f93d-411f-8e69-2a75164b3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_vif [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e92340f-f9, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:10 user nova-compute[70709]: INFO os_vif [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=7e92340f-f93d-411f-8e69-2a75164b3679,network=Network(02f93a99-911e-4a23-b3dc-8836139ed1bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e92340f-f9')
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f50ea2-ca7f-494c-b2f5-af8bd4c21623]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:10 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:23:10 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:10 user nova-compute[70709]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 (non-flash)
Jul 28 00:23:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:10 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:23:10 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:10 user nova-compute[70709]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 (non-flash)
Jul 28 00:23:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaVgHnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:23:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef84c9fa-d00a-4364-8072-1fb763a49a2a]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:23:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwSNfhYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26162366531633534', 'path': '/dev/sde'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162366531633534', 'path': '/dev/sde'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.025s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG nova.objects.instance [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'flavor' on Instance uuid 75132de4-0252-4bee-bb51-24602cc586ba {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4468ec-beba-487a-aa30-63eaa2d2c9ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:23:11 user nova-compute[70709]: No targets found.
Jul 28 00:23:11 user nova-compute[70709]: iSNS:
Jul 28 00:23:11 user nova-compute[70709]: No targets found.
Jul 28 00:23:11 user nova-compute[70709]: STATIC:
Jul 28 00:23:11 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a
Jul 28 00:23:11 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:11 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:11 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c
Jul 28 00:23:11 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:11 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:11 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:23:11 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:11 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:11 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2
Jul 28 00:23:11 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:11 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:11 user nova-compute[70709]: FIRMWARE:
Jul 28 00:23:11 user nova-compute[70709]: No targets found.
Jul 28 00:23:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:23:11 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:23:11 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:23:11 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:23:11 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:23:11 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:23:11 user nova-compute[70709]:   <serial>49dd8679-b3c1-4907-9fb3-3d0b795d16c2</serial>
Jul 28 00:23:11 user nova-compute[70709]: </disk>
Jul 28 00:23:11 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3393e630-21bf-4329-9952-3f84c5f39d3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[26edae4f-0db1-4ab5-98b6-75cd3702de1e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:11 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:23:11 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:11 user nova-compute[70709]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 (non-flash)
Jul 28 00:23:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:11 user nova-compute[70709]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c (non-flash)
Jul 28 00:23:11 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:11 user nova-compute[70709]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 (non-flash)
Jul 28 00:23:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b8857f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c'): ({'sdd'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Removing single pathed devices sdd {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[577473a6-b4c4-4270-ab62-91d1bca8c644]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80f7ddf-a4f0-4814-bbf5-cfc27c37d782]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Flushing IO for device /dev/sdd {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[667ee051-4976-448a-a413-2b63fee7d8ac]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e7b4f0-b999-4aee-80d4-6284717c3a9b]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b8c7b9-641a-4114-bea6-3e6afbd2a894]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee192565-0663-4d63-aa84-5526e2899f13]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260]
Jul 28 00:23:11 user nova-compute[70709]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c, portal: 172.16.0.220,3260] successful.
Jul 28 00:23:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b782c7-df0d-4e2a-8b05-6dba869dde7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f05bee-f6a8-4dd8-bc19-c45f9c10f0ac]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] <== disconnect_volume: return (1374ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:23:11 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Deleting instance files /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c_del
Jul 28 00:23:11 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Deletion of /opt/stack/data/nova/instances/df55bbd3-31ab-42f8-9a71-4ed8e3c4428c_del complete
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:23:11 user nova-compute[70709]: INFO nova.compute.manager [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Took 2.37 seconds to destroy the instance on the hypervisor.
Jul 28 00:23:11 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:23:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No VIF found with MAC fa:16:3e:de:67:06, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-8c2c6733-1472-4296-9879-6822654c552b req-9f7dbd8e-bf4b-49ba-9a7f-82ffc270b073 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c2c6733-1472-4296-9879-6822654c552b req-9f7dbd8e-bf4b-49ba-9a7f-82ffc270b073 service nova] Acquiring lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c2c6733-1472-4296-9879-6822654c552b req-9f7dbd8e-bf4b-49ba-9a7f-82ffc270b073 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8c2c6733-1472-4296-9879-6822654c552b req-9f7dbd8e-bf4b-49ba-9a7f-82ffc270b073 service nova] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-8c2c6733-1472-4296-9879-6822654c552b req-9f7dbd8e-bf4b-49ba-9a7f-82ffc270b073 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] No waiting events found dispatching network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:12 user nova-compute[70709]: WARNING nova.compute.manager [req-8c2c6733-1472-4296-9879-6822654c552b req-9f7dbd8e-bf4b-49ba-9a7f-82ffc270b073 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received unexpected event network-vif-plugged-7e92340f-f93d-411f-8e69-2a75164b3679 for instance with vm_state active and task_state deleting.
Jul 28 00:23:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-cdb294e8-f019-4e71-bb9f-4fd7df59331f tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.030s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:23:12 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Took 0.90 seconds to deallocate network for instance.
Jul 28 00:23:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-554bab6f-5631-4414-8243-a8f676baf63a req-fad41161-f383-4da5-abd6-3c6435fdaa91 service nova] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Received event network-vif-deleted-7e92340f-f93d-411f-8e69-2a75164b3679 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:12 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "75132de4-0252-4bee-bb51-24602cc586ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:13 user nova-compute[70709]: INFO nova.compute.manager [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Detaching volume 49dd8679-b3c1-4907-9fb3-3d0b795d16c2
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:13 user nova-compute[70709]: INFO nova.virt.block_device [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Attempting to driver detach volume 49dd8679-b3c1-4907-9fb3-3d0b795d16c2 from mountpoint /dev/vdb
Jul 28 00:23:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Attempting to detach device vdb from instance 75132de4-0252-4bee-bb51-24602cc586ba from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:23:13 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:23:13 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:23:13 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:23:13 user nova-compute[70709]:   <serial>49dd8679-b3c1-4907-9fb3-3d0b795d16c2</serial>
Jul 28 00:23:13 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:23:13 user nova-compute[70709]: </disk>
Jul 28 00:23:13 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:23:13 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully detached device vdb from instance 75132de4-0252-4bee-bb51-24602cc586ba from the persistent domain config.
Jul 28 00:23:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75132de4-0252-4bee-bb51-24602cc586ba from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:23:13 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:23:13 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:23:13 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:23:13 user nova-compute[70709]:   <serial>49dd8679-b3c1-4907-9fb3-3d0b795d16c2</serial>
Jul 28 00:23:13 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:23:13 user nova-compute[70709]: </disk>
Jul 28 00:23:13 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:23:13 user nova-compute[70709]: INFO nova.compute.manager [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Took 0.84 seconds to detach 1 volumes for instance.
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503794.0865145, 75132de4-0252-4bee-bb51-24602cc586ba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75132de4-0252-4bee-bb51-24602cc586ba {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:23:14 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully detached device vdb from instance 75132de4-0252-4bee-bb51-24602cc586ba from the live domain config.
Jul 28 00:23:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwSNfhYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:23:14 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ca5e8d-8b20-4302-87f5-ec1f6a0e741e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:23:14 user nova-compute[70709]: No targets found.
Jul 28 00:23:14 user nova-compute[70709]: iSNS:
Jul 28 00:23:14 user nova-compute[70709]: No targets found.
Jul 28 00:23:14 user nova-compute[70709]: STATIC:
Jul 28 00:23:14 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a
Jul 28 00:23:14 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:14 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:14 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:23:14 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:14 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:14 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2
Jul 28 00:23:14 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:23:14 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:23:14 user nova-compute[70709]: FIRMWARE:
Jul 28 00:23:14 user nova-compute[70709]: No targets found.
Jul 28 00:23:14 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:23:14 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:23:14 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e08bae6-307e-4d9e-9bdd-4e5872abd123]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd2a24f-7f71-48a5-a3cc-5de7a5fe291b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:14 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:14 user nova-compute[70709]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 (non-flash)
Jul 28 00:23:14 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:14 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:14 user nova-compute[70709]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 (non-flash)
Jul 28 00:23:14 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90332b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2'): ({'sde'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Removing single pathed devices sde {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62afba5-5381-4907-a7ed-3e964c3fabb8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[caee44a9-4609-473c-922a-960382f38e4c]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Flushing IO for device /dev/sde {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12849e3-d5e5-4147-9d91-2bf30b111c42]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7039c6-202f-4be2-a35f-96c7f29d9e83]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea48a67-e009-4140-a20e-5362b87fc305]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Deleted allocations for instance df55bbd3-31ab-42f8-9a71-4ed8e3c4428c
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdbf083-345b-47fe-819d-898dad5c7deb]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2, portal: 172.16.0.220,3260]
Jul 28 00:23:14 user nova-compute[70709]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2, portal: 172.16.0.220,3260] successful.
Jul 28 00:23:14 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd8679-b3c1-4907-9fb3-3d0b795d16c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c026015-3907-4635-8437-11c45790107b]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] <== disconnect_volume: return (450ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b7ab5a69-3cb7-43e1-a134-6a87ac2cb2ca tempest-ServerActionsTestOtherB-1900188209 tempest-ServerActionsTestOtherB-1900188209-project-member] Lock "df55bbd3-31ab-42f8-9a71-4ed8e3c4428c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.081s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG nova.objects.instance [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'flavor' on Instance uuid 75132de4-0252-4bee-bb51-24602cc586ba {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dfd27528-4925-4e73-8f32-8e523d5f2875 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.194s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:23:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:23:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7388MB free_disk=25.298580169677734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 8168aa39-afce-4c9e-ba76-78a760767357 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance c6297718-d595-4657-aa32-aa75bffdf955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 30ac2ae7-04f8-407e-8aee-1c515b61d564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 75132de4-0252-4bee-bb51-24602cc586ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 552ba43b-6f39-4a9d-a93e-bb2831324d01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance e5fa42c1-2530-48d2-807c-ffbf9b2b355f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:23:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:23:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:17 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:23:17 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:23:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:23:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:23:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:23:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:23:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:23:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:23:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:23:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:23:19 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503784.887132, 552ba43b-6f39-4a9d-a93e-bb2831324d01 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:23:19 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] VM Stopped (Lifecycle Event)
Jul 28 00:23:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c1693051-c3f3-4c1d-9e50-d7a6270fde40 None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:23:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:23:20 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:23:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:20 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updating instance_info_cache with network_info: [{"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:23:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-2bb828f4-bb7d-4754-bcaa-38f2954b8eee" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:23:20 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:23:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:23:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:22 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:23:25 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503790.3497753, df55bbd3-31ab-42f8-9a71-4ed8e3c4428c => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:23:25 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] VM Stopped (Lifecycle Event)
Jul 28 00:23:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-1fb69a9f-8d43-4ca2-80da-4b91a9f39caa None None] [instance: df55bbd3-31ab-42f8-9a71-4ed8e3c4428c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a04d44af-d948-411d-b923-6113d56d651b req-c9f72603-d41d-4803-a7a8-06ecdce8afd0 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event volume-reimaged-57830a9a-041e-4dc0-b2e7-ae09961e9860 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a04d44af-d948-411d-b923-6113d56d651b req-c9f72603-d41d-4803-a7a8-06ecdce8afd0 service nova] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a04d44af-d948-411d-b923-6113d56d651b req-c9f72603-d41d-4803-a7a8-06ecdce8afd0 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a04d44af-d948-411d-b923-6113d56d651b req-c9f72603-d41d-4803-a7a8-06ecdce8afd0 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a04d44af-d948-411d-b923-6113d56d651b req-c9f72603-d41d-4803-a7a8-06ecdce8afd0 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Processing event volume-reimaged-57830a9a-041e-4dc0-b2e7-ae09961e9860 {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:23:27 user nova-compute[70709]: INFO nova.virt.block_device [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Booting with volume 57830a9a-041e-4dc0-b2e7-ae09961e9860 at /dev/vda
Jul 28 00:23:27 user nova-compute[70709]: DEBUG os_brick.utils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f31e2b-bd15-4ca0-851e-64b57d5e0e1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd1cfce-d02c-407d-afa3-1c2acf5bd9a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[37560ae5-cad5-432e-adff-ecb3ef910836]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2beeb96-ff3a-43ff-b518-334a48a02edf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:23:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:23:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:23:28 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:23:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35e4189-cdb9-4487-ab5b-9bb509eabba3]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:23:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:23:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:23:28 user nova-compute[70709]: DEBUG os_brick.utils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] <== get_connector_properties: return (231ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:23:28 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Updating existing volume attachment record: e556a92f-3a51-4b34-9c26-2b75976e55d4 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:23:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b451d103-db00-4cea-86ed-d23cab6120f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:23:29 user nova-compute[70709]: INFO nova.compute.claims [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Claim successful on node user
Jul 28 00:23:29 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG nova.network.neutron [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:23:29 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:23:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:23:29 user nova-compute[70709]: INFO nova.virt.block_device [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Booting with volume 99c4acdd-1e96-4dc5-9c0f-78668c233efd at /dev/vda
Jul 28 00:23:29 user nova-compute[70709]: DEBUG nova.policy [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '384ba52cf0bd4f03ac0dfc73cc81b31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce75e559c74038919f88f186e35a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG os_brick.utils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e727fa0-a980-41aa-b5b4-fcaf945d059a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df755a7-ba54-4b5b-94a1-6f3a9298a209]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d6cca1-1985-4b50-8ec4-94b8aea58a01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fe4003-1054-4cdd-8c7a-7857c2a2e0cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:23:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:23:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:23:30 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:23:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5fdfad-3d45-4cb6-ba65-5b38e0bbb2f8]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:23:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:23:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:23:30 user nova-compute[70709]: DEBUG os_brick.utils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:23:30 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updating existing volume attachment record: c47aee5c-b94b-416f-9450-473dea933203 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:23:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:30 user nova-compute[70709]: DEBUG nova.network.neutron [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Successfully created port: 23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:23:31 user nova-compute[70709]: DEBUG nova.network.neutron [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Successfully updated port: 23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquired lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG nova.network.neutron [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-ca659855-3236-4f01-b8fc-f7403a7f9254 req-7d3ad063-519c-4cfc-affb-0bb4cf3f035a service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-changed-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-ca659855-3236-4f01-b8fc-f7403a7f9254 req-7d3ad063-519c-4cfc-affb-0bb4cf3f035a service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Refreshing instance network info cache due to event network-changed-23cdc0f2-530f-439d-b533-dea81f764fdf. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ca659855-3236-4f01-b8fc-f7403a7f9254 req-7d3ad063-519c-4cfc-affb-0bb4cf3f035a service nova] Acquiring lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG nova.network.neutron [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG nova.network.neutron [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updating instance_info_cache with network_info: [{"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Releasing lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Instance network_info: |[{"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ca659855-3236-4f01-b8fc-f7403a7f9254 req-7d3ad063-519c-4cfc-affb-0bb4cf3f035a service nova] Acquired lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG nova.network.neutron [req-ca659855-3236-4f01-b8fc-f7403a7f9254 req-7d3ad063-519c-4cfc-affb-0bb4cf3f035a service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Refreshing network info cache for port 23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG nova.network.neutron [req-ca659855-3236-4f01-b8fc-f7403a7f9254 req-7d3ad063-519c-4cfc-affb-0bb4cf3f035a service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updated VIF entry in instance network info cache for port 23cdc0f2-530f-439d-b533-dea81f764fdf. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG nova.network.neutron [req-ca659855-3236-4f01-b8fc-f7403a7f9254 req-7d3ad063-519c-4cfc-affb-0bb4cf3f035a service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updating instance_info_cache with network_info: [{"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:23:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ca659855-3236-4f01-b8fc-f7403a7f9254 req-7d3ad063-519c-4cfc-affb-0bb4cf3f035a service nova] Releasing lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:23:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:34 user nova-compute[70709]: INFO nova.compute.manager [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Terminating instance
Jul 28 00:23:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:23:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG nova.compute.manager [req-073f88d0-522e-49b4-af49-0244026009e6 req-262c5d35-6b17-4b91-b8a1-421018a8a5a0 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Received event network-vif-unplugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-073f88d0-522e-49b4-af49-0244026009e6 req-262c5d35-6b17-4b91-b8a1-421018a8a5a0 service nova] Acquiring lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-073f88d0-522e-49b4-af49-0244026009e6 req-262c5d35-6b17-4b91-b8a1-421018a8a5a0 service nova] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-073f88d0-522e-49b4-af49-0244026009e6 req-262c5d35-6b17-4b91-b8a1-421018a8a5a0 service nova] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG nova.compute.manager [req-073f88d0-522e-49b4-af49-0244026009e6 req-262c5d35-6b17-4b91-b8a1-421018a8a5a0 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] No waiting events found dispatching network-vif-unplugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG nova.compute.manager [req-073f88d0-522e-49b4-af49-0244026009e6 req-262c5d35-6b17-4b91-b8a1-421018a8a5a0 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Received event network-vif-unplugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:35 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Instance destroyed successfully.
Jul 28 00:23:35 user nova-compute[70709]: DEBUG nova.objects.instance [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lazy-loading 'resources' on Instance uuid e5fa42c1-2530-48d2-807c-ffbf9b2b355f {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1733239116',display_name='tempest-VolumesAdminNegativeTest-server-1733239116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1733239116',id=21,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1181361da7694becb7e59b4b47eb0760',ramdisk_id='',reservation_id='r-xf66twu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-945099691',owner_user_name='tempest-VolumesAdminNegativeTest-945099691-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:21:42Z,user_data=None,user_id='e1ee7cb9ed044e10a022b23f51bcb588',uuid=e5fa42c1-2530-48d2-807c-ffbf9b2b355f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "address": "fa:16:3e:de:c0:67", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cabbda0-4e", "ovs_interfaceid": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converting VIF {"id": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "address": "fa:16:3e:de:c0:67", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cabbda0-4e", "ovs_interfaceid": "5cabbda0-4e7c-4ed5-a03b-23362bda59cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=5cabbda0-4e7c-4ed5-a03b-23362bda59cd,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cabbda0-4e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG os_vif [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=5cabbda0-4e7c-4ed5-a03b-23362bda59cd,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cabbda0-4e') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cabbda0-4e, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:23:35 user nova-compute[70709]: INFO os_vif [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=5cabbda0-4e7c-4ed5-a03b-23362bda59cd,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cabbda0-4e')
Jul 28 00:23:35 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Deleting instance files /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f_del
Jul 28 00:23:35 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Deletion of /opt/stack/data/nova/instances/e5fa42c1-2530-48d2-807c-ffbf9b2b355f_del complete
Jul 28 00:23:35 user nova-compute[70709]: INFO nova.compute.manager [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Took 0.75 seconds to destroy the instance on the hypervisor.
Jul 28 00:23:35 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:23:35 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:23:36 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Creating image(s)
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Ensure instance console log exists: /opt/stack/data/nova/instances/552ba43b-6f39-4a9d-a93e-bb2831324d01/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Start _get_guest_xml network_info=[{"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'e556a92f-3a51-4b34-9c26-2b75976e55d4', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTJaFlYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '552ba43b-6f39-4a9d-a93e-bb2831324d01', 'attached_at': '', 'detached_at': '', 'volume_id': '57830a9a-041e-4dc0-b2e7-ae09961e9860', 'serial': '57830a9a-041e-4dc0-b2e7-ae09961e9860'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:23:36 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 28 00:23:36 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lazy-loading 'vcpu_model' on Instance uuid 552ba43b-6f39-4a9d-a93e-bb2831324d01 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTJaFlYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:23:36 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:23:36 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:23:36 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-1fe25dcc-30de-456b-aaf5-d0c2ecbdda8f req-ca6467af-3ed1-48f2-a5c6-90002889403f service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Received event network-vif-deleted-5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:36 user nova-compute[70709]: INFO nova.compute.manager [req-1fe25dcc-30de-456b-aaf5-d0c2ecbdda8f req-ca6467af-3ed1-48f2-a5c6-90002889403f service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Neutron deleted interface 5cabbda0-4e7c-4ed5-a03b-23362bda59cd; detaching it from the instance and deleting it from the info cache
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.network.neutron [req-1fe25dcc-30de-456b-aaf5-d0c2ecbdda8f req-ca6467af-3ed1-48f2-a5c6-90002889403f service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:23:36 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Took 0.68 seconds to deallocate network for instance.
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3457fff-dae0-4b48-9089-6db6ebdc44d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:23:36 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-1fe25dcc-30de-456b-aaf5-d0c2ecbdda8f req-ca6467af-3ed1-48f2-a5c6-90002889403f service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Detach interface failed, port_id=5cabbda0-4e7c-4ed5-a03b-23362bda59cd, reason: Instance e5fa42c1-2530-48d2-807c-ffbf9b2b355f could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c83ca36-b9ed-4a4e-b289-4f7de7fbe9d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860] added
Jul 28 00:23:36 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e6f0e1-5757-4925-adad-0352ecdf5561]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd26e1-cfe6-4616-ba0c-bbb591542f3d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTJaFlYG {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTJaFlYG" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6b9f3b-7499-46e5-bdb1-9411a4cefcfc]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pTJaFlYG'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[caae75ac-6c7e-486e-902f-d5a461b2d908]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c443e1-bfc4-4b30-ae5e-f2b8f04fcc44]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:36 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:36 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:36 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:36 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[230ddc61-9afb-4254-8470-319fd49ca271]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260]
Jul 28 00:23:36 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260] successful.
Jul 28 00:23:36 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff97353-5b2f-4aad-8000-478be482d4c4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898c4b9-d58d-442d-91a1-8a2145942b8b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:36 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:36 user nova-compute[70709]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:23:36 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:36 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:36 user nova-compute[70709]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:23:36 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccdd557-9b5d-4588-9807-2c28550289da]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTJaFlYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:36 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Deleted allocations for instance e5fa42c1-2530-48d2-807c-ffbf9b2b355f
Jul 28 00:23:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-4212cb4a-57ad-417d-8ff8-f193890f3d23 tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.129s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.compute.manager [req-80adb339-8b6e-48f7-9202-8f6f0f39f48c req-e265709d-03ee-4984-9435-2727a69b1186 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Received event network-vif-plugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-80adb339-8b6e-48f7-9202-8f6f0f39f48c req-e265709d-03ee-4984-9435-2727a69b1186 service nova] Acquiring lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-80adb339-8b6e-48f7-9202-8f6f0f39f48c req-e265709d-03ee-4984-9435-2727a69b1186 service nova] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-80adb339-8b6e-48f7-9202-8f6f0f39f48c req-e265709d-03ee-4984-9435-2727a69b1186 service nova] Lock "e5fa42c1-2530-48d2-807c-ffbf9b2b355f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.compute.manager [req-80adb339-8b6e-48f7-9202-8f6f0f39f48c req-e265709d-03ee-4984-9435-2727a69b1186 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] No waiting events found dispatching network-vif-plugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:37 user nova-compute[70709]: WARNING nova.compute.manager [req-80adb339-8b6e-48f7-9202-8f6f0f39f48c req-e265709d-03ee-4984-9435-2727a69b1186 service nova] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Received unexpected event network-vif-plugged-5cabbda0-4e7c-4ed5-a03b-23362bda59cd for instance with vm_state deleted and task_state None.
Jul 28 00:23:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23763663461333133', 'path': '/dev/sdd'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763663461333133', 'path': '/dev/sdd'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T00:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-260409921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1150596554',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTphqF5bcF3n3OoMRDgsPxmVaUYJwZyxO441ggHQIolrfJ5FpS+UvFhc6UHNKt8wYOsoG6vj9jSalQ6YygK6u0e05rHRBkpcdU+YG6jEUzfArQfV3iGatSOnUZeh6becA==',key_name='tempest-keypair-382930470',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='526ce0f27cc343a5ac86331ee21076ec',ramdisk_id='',reservation_id='r-i95b6tf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1273279077',owner_user_name='tempest-ServerActionsV293TestJSON-1273279077-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:23:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b436a6349354f97a81ea3977aec28a5',uuid=552ba43b-6f39-4a9d-a93e-bb2831324d01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converting VIF {"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:23:37 user nova-compute[70709]:   <uuid>552ba43b-6f39-4a9d-a93e-bb2831324d01</uuid>
Jul 28 00:23:37 user nova-compute[70709]:   <name>instance-00000014</name>
Jul 28 00:23:37 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:23:37 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:23:37 user nova-compute[70709]:   <metadata>
Jul 28 00:23:37 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:23:37 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:23:37 user nova-compute[70709]:       <nova:name>tempest-ServerActionsV293TestJSON-server-260409921</nova:name>
Jul 28 00:23:37 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:23:36</nova:creationTime>
Jul 28 00:23:37 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:23:37 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:23:37 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:23:37 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:23:37 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:23:37 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:23:37 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:23:37 user nova-compute[70709]:       <nova:owner>
Jul 28 00:23:37 user nova-compute[70709]:         <nova:user uuid="8b436a6349354f97a81ea3977aec28a5">tempest-ServerActionsV293TestJSON-1273279077-project-member</nova:user>
Jul 28 00:23:37 user nova-compute[70709]:         <nova:project uuid="526ce0f27cc343a5ac86331ee21076ec">tempest-ServerActionsV293TestJSON-1273279077</nova:project>
Jul 28 00:23:37 user nova-compute[70709]:       </nova:owner>
Jul 28 00:23:37 user nova-compute[70709]:       <nova:ports>
Jul 28 00:23:37 user nova-compute[70709]:         <nova:port uuid="3bf19206-8843-4662-a147-edec46431a9b">
Jul 28 00:23:37 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 28 00:23:37 user nova-compute[70709]:         </nova:port>
Jul 28 00:23:37 user nova-compute[70709]:       </nova:ports>
Jul 28 00:23:37 user nova-compute[70709]:     </nova:instance>
Jul 28 00:23:37 user nova-compute[70709]:   </metadata>
Jul 28 00:23:37 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:23:37 user nova-compute[70709]:     <system>
Jul 28 00:23:37 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:23:37 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:23:37 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:23:37 user nova-compute[70709]:       <entry name="serial">552ba43b-6f39-4a9d-a93e-bb2831324d01</entry>
Jul 28 00:23:37 user nova-compute[70709]:       <entry name="uuid">552ba43b-6f39-4a9d-a93e-bb2831324d01</entry>
Jul 28 00:23:37 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:23:37 user nova-compute[70709]:     </system>
Jul 28 00:23:37 user nova-compute[70709]:   </sysinfo>
Jul 28 00:23:37 user nova-compute[70709]:   <os>
Jul 28 00:23:37 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:23:37 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:23:37 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:23:37 user nova-compute[70709]:   </os>
Jul 28 00:23:37 user nova-compute[70709]:   <features>
Jul 28 00:23:37 user nova-compute[70709]:     <acpi/>
Jul 28 00:23:37 user nova-compute[70709]:     <apic/>
Jul 28 00:23:37 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:23:37 user nova-compute[70709]:   </features>
Jul 28 00:23:37 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:23:37 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:23:37 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:23:37 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:23:37 user nova-compute[70709]:   </clock>
Jul 28 00:23:37 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:23:37 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:23:37 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:23:37 user nova-compute[70709]:   </cpu>
Jul 28 00:23:37 user nova-compute[70709]:   <devices>
Jul 28 00:23:37 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:23:37 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:23:37 user nova-compute[70709]:       <source dev="/dev/sdd"/>
Jul 28 00:23:37 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:23:37 user nova-compute[70709]:       <serial>57830a9a-041e-4dc0-b2e7-ae09961e9860</serial>
Jul 28 00:23:37 user nova-compute[70709]:     </disk>
Jul 28 00:23:37 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:23:37 user nova-compute[70709]:       <mac address="fa:16:3e:7a:3c:b5"/>
Jul 28 00:23:37 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:23:37 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:23:37 user nova-compute[70709]:       <target dev="tap3bf19206-88"/>
Jul 28 00:23:37 user nova-compute[70709]:     </interface>
Jul 28 00:23:37 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:23:37 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/552ba43b-6f39-4a9d-a93e-bb2831324d01/console.log" append="off"/>
Jul 28 00:23:37 user nova-compute[70709]:     </serial>
Jul 28 00:23:37 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:23:37 user nova-compute[70709]:     <video>
Jul 28 00:23:37 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:23:37 user nova-compute[70709]:     </video>
Jul 28 00:23:37 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:23:37 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:23:37 user nova-compute[70709]:     </rng>
Jul 28 00:23:37 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:23:37 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:23:37 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:23:37 user nova-compute[70709]:     </memballoon>
Jul 28 00:23:37 user nova-compute[70709]:   </devices>
Jul 28 00:23:37 user nova-compute[70709]: </domain>
Jul 28 00:23:37 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T00:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-260409921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1150596554',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTphqF5bcF3n3OoMRDgsPxmVaUYJwZyxO441ggHQIolrfJ5FpS+UvFhc6UHNKt8wYOsoG6vj9jSalQ6YygK6u0e05rHRBkpcdU+YG6jEUzfArQfV3iGatSOnUZeh6becA==',key_name='tempest-keypair-382930470',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='526ce0f27cc343a5ac86331ee21076ec',ramdisk_id='',reservation_id='r-i95b6tf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1273279077',owner_user_name='tempest-ServerActionsV293TestJSON-1273279077-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:23:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b436a6349354f97a81ea3977aec28a5',uuid=552ba43b-6f39-4a9d-a93e-bb2831324d01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converting VIF {"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG os_vif [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bf19206-88, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3bf19206-88, col_values=(('external_ids', {'iface-id': '3bf19206-8843-4662-a147-edec46431a9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:3c:b5', 'vm-uuid': '552ba43b-6f39-4a9d-a93e-bb2831324d01'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:37 user nova-compute[70709]: INFO os_vif [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88')
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:23:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] No VIF found with MAC fa:16:3e:7a:3c:b5, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:23:38 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Creating image(s)
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Ensure instance console log exists: /opt/stack/data/nova/instances/b451d103-db00-4cea-86ed-d23cab6120f5/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Start _get_guest_xml network_info=[{"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'c47aee5c-b94b-416f-9450-473dea933203', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUCivjol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b451d103-db00-4cea-86ed-d23cab6120f5', 'attached_at': '', 'detached_at': '', 'volume_id': '99c4acdd-1e96-4dc5-9c0f-78668c233efd', 'serial': '99c4acdd-1e96-4dc5-9c0f-78668c233efd'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:23:38 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:23:38 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUCivjol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:23:38 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:23:38 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:23:38 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7b79b0-474a-4a1d-9b6c-765542573672]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:23:38 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc526444-f4b0-4877-90b4-f14a25845959]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd] added
Jul 28 00:23:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bf915a-35ce-42bf-9fbe-24cf5ce828db]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4745804-b8cf-4d1c-aade-9054616da11e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUCivjol {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUCivjol" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6a1c6-900d-4a5d-ac11-3e433d905fea]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aUCivjol'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[09564a9f-8236-4892-8352-0e69aa82d58a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5da16a-76de-4340-b71b-2741d0bbfcf5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:38 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:38 user nova-compute[70709]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:23:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:38 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:38 user nova-compute[70709]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:23:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb7a3bd-6fba-4e4b-b72d-a43c9d588a7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260]
Jul 28 00:23:38 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260] successful.
Jul 28 00:23:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf3487a-081f-4647-b673-73c8f5667d88]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc008c4f-c2ee-44ee-9b75-5b19cfe8cb07]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:38 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:38 user nova-compute[70709]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:23:38 user nova-compute[70709]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:23:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:23:38 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:23:38 user nova-compute[70709]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:23:38 user nova-compute[70709]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:23:38 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bf6e7c-8746-481b-aa7a-4454518f871a]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:23:38 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUCivjol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.compute.manager [req-d6bbd8a6-44de-4044-bc48-e13ff2a4d79b req-d7a102b5-9b3c-4a03-aed8-7bd9564b1027 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6bbd8a6-44de-4044-bc48-e13ff2a4d79b req-d7a102b5-9b3c-4a03-aed8-7bd9564b1027 service nova] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6bbd8a6-44de-4044-bc48-e13ff2a4d79b req-d7a102b5-9b3c-4a03-aed8-7bd9564b1027 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6bbd8a6-44de-4044-bc48-e13ff2a4d79b req-d7a102b5-9b3c-4a03-aed8-7bd9564b1027 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.compute.manager [req-d6bbd8a6-44de-4044-bc48-e13ff2a4d79b req-d7a102b5-9b3c-4a03-aed8-7bd9564b1027 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] No waiting events found dispatching network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:39 user nova-compute[70709]: WARNING nova.compute.manager [req-d6bbd8a6-44de-4044-bc48-e13ff2a4d79b req-d7a102b5-9b3c-4a03-aed8-7bd9564b1027 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received unexpected event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b for instance with vm_state active and task_state rebuild_spawning.
Jul 28 00:23:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '26136313263333866', 'path': '/dev/sde'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136313263333866', 'path': '/dev/sde'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1501930603',display_name='tempest-ServerActionsTestOtherA-server-1501930603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1501930603',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-7hnta9w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:23:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b451d103-db00-4cea-86ed-d23cab6120f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.objects.instance [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'pci_devices' on Instance uuid b451d103-db00-4cea-86ed-d23cab6120f5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:23:39 user nova-compute[70709]:   <uuid>b451d103-db00-4cea-86ed-d23cab6120f5</uuid>
Jul 28 00:23:39 user nova-compute[70709]:   <name>instance-00000017</name>
Jul 28 00:23:39 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:23:39 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:23:39 user nova-compute[70709]:   <metadata>
Jul 28 00:23:39 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:23:39 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:23:39 user nova-compute[70709]:       <nova:name>tempest-ServerActionsTestOtherA-server-1501930603</nova:name>
Jul 28 00:23:39 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:23:38</nova:creationTime>
Jul 28 00:23:39 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:23:39 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:23:39 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:23:39 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:23:39 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:23:39 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:23:39 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:23:39 user nova-compute[70709]:       <nova:owner>
Jul 28 00:23:39 user nova-compute[70709]:         <nova:user uuid="384ba52cf0bd4f03ac0dfc73cc81b31d">tempest-ServerActionsTestOtherA-448184614-project-member</nova:user>
Jul 28 00:23:39 user nova-compute[70709]:         <nova:project uuid="92ce75e559c74038919f88f186e35a17">tempest-ServerActionsTestOtherA-448184614</nova:project>
Jul 28 00:23:39 user nova-compute[70709]:       </nova:owner>
Jul 28 00:23:39 user nova-compute[70709]:       <nova:ports>
Jul 28 00:23:39 user nova-compute[70709]:         <nova:port uuid="23cdc0f2-530f-439d-b533-dea81f764fdf">
Jul 28 00:23:39 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 28 00:23:39 user nova-compute[70709]:         </nova:port>
Jul 28 00:23:39 user nova-compute[70709]:       </nova:ports>
Jul 28 00:23:39 user nova-compute[70709]:     </nova:instance>
Jul 28 00:23:39 user nova-compute[70709]:   </metadata>
Jul 28 00:23:39 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:23:39 user nova-compute[70709]:     <system>
Jul 28 00:23:39 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:23:39 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:23:39 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:23:39 user nova-compute[70709]:       <entry name="serial">b451d103-db00-4cea-86ed-d23cab6120f5</entry>
Jul 28 00:23:39 user nova-compute[70709]:       <entry name="uuid">b451d103-db00-4cea-86ed-d23cab6120f5</entry>
Jul 28 00:23:39 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:23:39 user nova-compute[70709]:     </system>
Jul 28 00:23:39 user nova-compute[70709]:   </sysinfo>
Jul 28 00:23:39 user nova-compute[70709]:   <os>
Jul 28 00:23:39 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:23:39 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:23:39 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:23:39 user nova-compute[70709]:   </os>
Jul 28 00:23:39 user nova-compute[70709]:   <features>
Jul 28 00:23:39 user nova-compute[70709]:     <acpi/>
Jul 28 00:23:39 user nova-compute[70709]:     <apic/>
Jul 28 00:23:39 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:23:39 user nova-compute[70709]:   </features>
Jul 28 00:23:39 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:23:39 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:23:39 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:23:39 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:23:39 user nova-compute[70709]:   </clock>
Jul 28 00:23:39 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:23:39 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:23:39 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:23:39 user nova-compute[70709]:   </cpu>
Jul 28 00:23:39 user nova-compute[70709]:   <devices>
Jul 28 00:23:39 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:23:39 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:23:39 user nova-compute[70709]:       <source dev="/dev/sde"/>
Jul 28 00:23:39 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:23:39 user nova-compute[70709]:       <serial>99c4acdd-1e96-4dc5-9c0f-78668c233efd</serial>
Jul 28 00:23:39 user nova-compute[70709]:     </disk>
Jul 28 00:23:39 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:23:39 user nova-compute[70709]:       <mac address="fa:16:3e:a1:ba:61"/>
Jul 28 00:23:39 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:23:39 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:23:39 user nova-compute[70709]:       <target dev="tap23cdc0f2-53"/>
Jul 28 00:23:39 user nova-compute[70709]:     </interface>
Jul 28 00:23:39 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:23:39 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/b451d103-db00-4cea-86ed-d23cab6120f5/console.log" append="off"/>
Jul 28 00:23:39 user nova-compute[70709]:     </serial>
Jul 28 00:23:39 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:23:39 user nova-compute[70709]:     <video>
Jul 28 00:23:39 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:23:39 user nova-compute[70709]:     </video>
Jul 28 00:23:39 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:23:39 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:23:39 user nova-compute[70709]:     </rng>
Jul 28 00:23:39 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:23:39 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:23:39 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:23:39 user nova-compute[70709]:     </memballoon>
Jul 28 00:23:39 user nova-compute[70709]:   </devices>
Jul 28 00:23:39 user nova-compute[70709]: </domain>
Jul 28 00:23:39 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1501930603',display_name='tempest-ServerActionsTestOtherA-server-1501930603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1501930603',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-7hnta9w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:23:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b451d103-db00-4cea-86ed-d23cab6120f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG os_vif [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23cdc0f2-53, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23cdc0f2-53, col_values=(('external_ids', {'iface-id': '23cdc0f2-530f-439d-b533-dea81f764fdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:ba:61', 'vm-uuid': 'b451d103-db00-4cea-86ed-d23cab6120f5'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:39 user nova-compute[70709]: INFO os_vif [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53')
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:23:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No VIF found with MAC fa:16:3e:a1:ba:61, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:23:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-7eda12c7-0128-4469-801e-9ed66cc30064 req-1c98e3fe-ffd2-4453-8288-ef8600674065 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7eda12c7-0128-4469-801e-9ed66cc30064 req-1c98e3fe-ffd2-4453-8288-ef8600674065 service nova] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7eda12c7-0128-4469-801e-9ed66cc30064 req-1c98e3fe-ffd2-4453-8288-ef8600674065 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7eda12c7-0128-4469-801e-9ed66cc30064 req-1c98e3fe-ffd2-4453-8288-ef8600674065 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-7eda12c7-0128-4469-801e-9ed66cc30064 req-1c98e3fe-ffd2-4453-8288-ef8600674065 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] No waiting events found dispatching network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:41 user nova-compute[70709]: WARNING nova.compute.manager [req-7eda12c7-0128-4469-801e-9ed66cc30064 req-1c98e3fe-ffd2-4453-8288-ef8600674065 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received unexpected event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf for instance with vm_state building and task_state spawning.
Jul 28 00:23:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-bfa30fd2-1508-465f-8434-609156dbc294 req-f5242119-f097-4aad-8f14-404254574b25 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bfa30fd2-1508-465f-8434-609156dbc294 req-f5242119-f097-4aad-8f14-404254574b25 service nova] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bfa30fd2-1508-465f-8434-609156dbc294 req-f5242119-f097-4aad-8f14-404254574b25 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bfa30fd2-1508-465f-8434-609156dbc294 req-f5242119-f097-4aad-8f14-404254574b25 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-bfa30fd2-1508-465f-8434-609156dbc294 req-f5242119-f097-4aad-8f14-404254574b25 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] No waiting events found dispatching network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:41 user nova-compute[70709]: WARNING nova.compute.manager [req-bfa30fd2-1508-465f-8434-609156dbc294 req-f5242119-f097-4aad-8f14-404254574b25 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received unexpected event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b for instance with vm_state active and task_state rebuild_spawning.
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503821.6055477, 552ba43b-6f39-4a9d-a93e-bb2831324d01 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:23:41 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] VM Resumed (Lifecycle Event)
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:41 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Instance spawned successfully.
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:23:41 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503821.6082258, 552ba43b-6f39-4a9d-a93e-bb2831324d01 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:23:41 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] VM Started (Lifecycle Event)
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:23:41 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70709) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 28 00:23:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a04d44af-d948-411d-b923-6113d56d651b tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-a857eb00-f1c9-4ddf-a451-91e10e9a5c82 req-b9604ff8-d9b5-4208-8da9-a01832fe40e6 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a857eb00-f1c9-4ddf-a451-91e10e9a5c82 req-b9604ff8-d9b5-4208-8da9-a01832fe40e6 service nova] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a857eb00-f1c9-4ddf-a451-91e10e9a5c82 req-b9604ff8-d9b5-4208-8da9-a01832fe40e6 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a857eb00-f1c9-4ddf-a451-91e10e9a5c82 req-b9604ff8-d9b5-4208-8da9-a01832fe40e6 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-a857eb00-f1c9-4ddf-a451-91e10e9a5c82 req-b9604ff8-d9b5-4208-8da9-a01832fe40e6 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] No waiting events found dispatching network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:43 user nova-compute[70709]: WARNING nova.compute.manager [req-a857eb00-f1c9-4ddf-a451-91e10e9a5c82 req-b9604ff8-d9b5-4208-8da9-a01832fe40e6 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received unexpected event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf for instance with vm_state building and task_state spawning.
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503823.643451, b451d103-db00-4cea-86ed-d23cab6120f5 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:23:43 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] VM Resumed (Lifecycle Event)
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.compute.manager [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:23:43 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Instance spawned successfully.
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:23:43 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503823.6475737, b451d103-db00-4cea-86ed-d23cab6120f5 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:23:43 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] VM Started (Lifecycle Event)
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:23:43 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:23:43 user nova-compute[70709]: INFO nova.compute.manager [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Took 5.69 seconds to spawn the instance on the hypervisor.
Jul 28 00:23:43 user nova-compute[70709]: DEBUG nova.compute.manager [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:43 user nova-compute[70709]: INFO nova.compute.manager [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Took 14.85 seconds to build instance.
Jul 28 00:23:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-937b2aaa-0a3e-4833-bcad-ed56bf5f37b3 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b451d103-db00-4cea-86ed-d23cab6120f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.949s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:50 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503815.440345, e5fa42c1-2530-48d2-807c-ffbf9b2b355f => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:23:50 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] VM Stopped (Lifecycle Event)
Jul 28 00:23:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d25c44c7-0c9c-4359-a3c8-ef799960950b None None] [instance: e5fa42c1-2530-48d2-807c-ffbf9b2b355f] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:23:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:58 user nova-compute[70709]: INFO nova.compute.manager [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Terminating instance
Jul 28 00:23:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:23:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-343c2a76-5d15-4f17-94a0-096ba469c559 req-a7391d09-734b-4790-adbd-368ed6ccde78 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-unplugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-343c2a76-5d15-4f17-94a0-096ba469c559 req-a7391d09-734b-4790-adbd-368ed6ccde78 service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-343c2a76-5d15-4f17-94a0-096ba469c559 req-a7391d09-734b-4790-adbd-368ed6ccde78 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-343c2a76-5d15-4f17-94a0-096ba469c559 req-a7391d09-734b-4790-adbd-368ed6ccde78 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-343c2a76-5d15-4f17-94a0-096ba469c559 req-a7391d09-734b-4790-adbd-368ed6ccde78 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-unplugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-343c2a76-5d15-4f17-94a0-096ba469c559 req-a7391d09-734b-4790-adbd-368ed6ccde78 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-unplugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:23:59 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Instance destroyed successfully.
Jul 28 00:23:59 user nova-compute[70709]: DEBUG nova.objects.instance [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'resources' on Instance uuid 2bb828f4-bb7d-4754-bcaa-38f2954b8eee {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2037149563',display_name='tempest-AttachVolumeTestJSON-server-2037149563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2037149563',id=4,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKNEuPphQPlRnxY0JBcdikh9eshk4/9r69y1/MqVTQrHKGifhAnKKVbTQ0Mknn4VbSSaaRD/uIrFnnbFbmKZbFAB4vCxq+B8edPPxFALUWCcXG/5W4U5PVq8d2KDtyakA==',key_name='tempest-keypair-1576770531',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-2xusewnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=2bb828f4-bb7d-4754-bcaa-38f2954b8eee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "address": "fa:16:3e:65:2d:ef", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff3e21e0-da", "ovs_interfaceid": "ff3e21e0-da08-4f60-a9fb-e1a4ea572467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG os_vif [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff3e21e0-da, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:23:59 user nova-compute[70709]: INFO os_vif [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff3e21e0-da')
Jul 28 00:23:59 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Deleting instance files /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee_del
Jul 28 00:23:59 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Deletion of /opt/stack/data/nova/instances/2bb828f4-bb7d-4754-bcaa-38f2954b8eee_del complete
Jul 28 00:23:59 user nova-compute[70709]: INFO nova.compute.manager [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 28 00:23:59 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:23:59 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:24:00 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:00 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Took 1.02 seconds to deallocate network for instance.
Jul 28 00:24:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-178718d9-f13b-4b65-a3cc-35493de0b138 req-abb48b7f-22bb-4125-a957-e85c47ce0ae3 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-deleted-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:00 user nova-compute[70709]: INFO nova.compute.manager [req-178718d9-f13b-4b65-a3cc-35493de0b138 req-abb48b7f-22bb-4125-a957-e85c47ce0ae3 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Neutron deleted interface ff3e21e0-da08-4f60-a9fb-e1a4ea572467; detaching it from the instance and deleting it from the info cache
Jul 28 00:24:00 user nova-compute[70709]: DEBUG nova.network.neutron [req-178718d9-f13b-4b65-a3cc-35493de0b138 req-abb48b7f-22bb-4125-a957-e85c47ce0ae3 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-178718d9-f13b-4b65-a3cc-35493de0b138 req-abb48b7f-22bb-4125-a957-e85c47ce0ae3 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Detach interface failed, port_id=ff3e21e0-da08-4f60-a9fb-e1a4ea572467, reason: Instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:24:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:01 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:24:01 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:24:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:01 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Deleted allocations for instance 2bb828f4-bb7d-4754-bcaa-38f2954b8eee
Jul 28 00:24:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-857db7bc-6c01-4c69-9e29-367073167809 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.584s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:01 user nova-compute[70709]: DEBUG nova.compute.manager [req-ac3cb490-9db5-4eb0-a167-36e1ec362a1a req-cb3b9870-6e54-438c-9322-1bdf1d20b320 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ac3cb490-9db5-4eb0-a167-36e1ec362a1a req-cb3b9870-6e54-438c-9322-1bdf1d20b320 service nova] Acquiring lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ac3cb490-9db5-4eb0-a167-36e1ec362a1a req-cb3b9870-6e54-438c-9322-1bdf1d20b320 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ac3cb490-9db5-4eb0-a167-36e1ec362a1a req-cb3b9870-6e54-438c-9322-1bdf1d20b320 service nova] Lock "2bb828f4-bb7d-4754-bcaa-38f2954b8eee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:01 user nova-compute[70709]: DEBUG nova.compute.manager [req-ac3cb490-9db5-4eb0-a167-36e1ec362a1a req-cb3b9870-6e54-438c-9322-1bdf1d20b320 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] No waiting events found dispatching network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:24:01 user nova-compute[70709]: WARNING nova.compute.manager [req-ac3cb490-9db5-4eb0-a167-36e1ec362a1a req-cb3b9870-6e54-438c-9322-1bdf1d20b320 service nova] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Received unexpected event network-vif-plugged-ff3e21e0-da08-4f60-a9fb-e1a4ea572467 for instance with vm_state deleted and task_state None.
Jul 28 00:24:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "44753afd-489f-48fa-ae42-0abaf29c2306" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:24:02 user nova-compute[70709]: INFO nova.compute.claims [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Claim successful on node user
Jul 28 00:24:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-e5298e5a-941a-4762-94f9-2d6419159676 req-6bb8b4ee-7d34-4e2b-bf58-688d29fba9bd service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-changed-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-e5298e5a-941a-4762-94f9-2d6419159676 req-6bb8b4ee-7d34-4e2b-bf58-688d29fba9bd service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Refreshing instance network info cache due to event network-changed-65acb4df-b4f6-4c60-ae40-7c65e73fc335. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5298e5a-941a-4762-94f9-2d6419159676 req-6bb8b4ee-7d34-4e2b-bf58-688d29fba9bd service nova] Acquiring lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5298e5a-941a-4762-94f9-2d6419159676 req-6bb8b4ee-7d34-4e2b-bf58-688d29fba9bd service nova] Acquired lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG nova.network.neutron [req-e5298e5a-941a-4762-94f9-2d6419159676 req-6bb8b4ee-7d34-4e2b-bf58-688d29fba9bd service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Refreshing network info cache for port 65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:24:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:24:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:02 user nova-compute[70709]: INFO nova.compute.manager [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Detaching volume 8be09f2b-9c75-4381-8295-df8913d7878a
Jul 28 00:24:02 user nova-compute[70709]: DEBUG nova.policy [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f3572ab427249b28aabc681b29619fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a044df80e01435e82b533b6392d5ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:24:03 user nova-compute[70709]: INFO nova.virt.block_device [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Attempting to driver detach volume 8be09f2b-9c75-4381-8295-df8913d7878a from mountpoint /dev/vdb
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:24:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Creating image(s)
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "/opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "/opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "/opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Attempting to detach device vdb from instance 30ac2ae7-04f8-407e-8aee-1c515b61d564 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:24:03 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:24:03 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:24:03 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:24:03 user nova-compute[70709]:   <serial>8be09f2b-9c75-4381-8295-df8913d7878a</serial>
Jul 28 00:24:03 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 28 00:24:03 user nova-compute[70709]: </disk>
Jul 28 00:24:03 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:24:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Successfully detached device vdb from instance 30ac2ae7-04f8-407e-8aee-1c515b61d564 from the persistent domain config.
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 30ac2ae7-04f8-407e-8aee-1c515b61d564 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:24:03 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:24:03 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:24:03 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:24:03 user nova-compute[70709]:   <serial>8be09f2b-9c75-4381-8295-df8913d7878a</serial>
Jul 28 00:24:03 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 28 00:24:03 user nova-compute[70709]: </disk>
Jul 28 00:24:03 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.158s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.170s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-38992ef9-2f00-4a06-b4a7-f996c5bfd4c0 req-0bd77a6e-b3b9-4063-804c-87aabff1f5d5 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-changed-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-38992ef9-2f00-4a06-b4a7-f996c5bfd4c0 req-0bd77a6e-b3b9-4063-804c-87aabff1f5d5 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Refreshing instance network info cache due to event network-changed-65acb4df-b4f6-4c60-ae40-7c65e73fc335. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-38992ef9-2f00-4a06-b4a7-f996c5bfd4c0 req-0bd77a6e-b3b9-4063-804c-87aabff1f5d5 service nova] Acquiring lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk 1073741824" returned: 0 in 0.102s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-e5298e5a-941a-4762-94f9-2d6419159676 req-6bb8b4ee-7d34-4e2b-bf58-688d29fba9bd service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updated VIF entry in instance network info cache for port 65acb4df-b4f6-4c60-ae40-7c65e73fc335. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-e5298e5a-941a-4762-94f9-2d6419159676 req-6bb8b4ee-7d34-4e2b-bf58-688d29fba9bd service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updating instance_info_cache with network_info: [{"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5298e5a-941a-4762-94f9-2d6419159676 req-6bb8b4ee-7d34-4e2b-bf58-688d29fba9bd service nova] Releasing lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-38992ef9-2f00-4a06-b4a7-f996c5bfd4c0 req-0bd77a6e-b3b9-4063-804c-87aabff1f5d5 service nova] Acquired lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-38992ef9-2f00-4a06-b4a7-f996c5bfd4c0 req-0bd77a6e-b3b9-4063-804c-87aabff1f5d5 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Refreshing network info cache for port 65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503843.6270306, 30ac2ae7-04f8-407e-8aee-1c515b61d564 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:24:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Successfully detached device vdb from instance 30ac2ae7-04f8-407e-8aee-1c515b61d564 from the live domain config.
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBjrhtSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:24:03 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[895fa09a-646c-49ab-b083-78b5113006af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:24:03 user nova-compute[70709]: No targets found.
Jul 28 00:24:03 user nova-compute[70709]: iSNS:
Jul 28 00:24:03 user nova-compute[70709]: No targets found.
Jul 28 00:24:03 user nova-compute[70709]: STATIC:
Jul 28 00:24:03 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd
Jul 28 00:24:03 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:24:03 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:24:03 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a
Jul 28 00:24:03 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:24:03 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:24:03 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860
Jul 28 00:24:03 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:24:03 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:24:03 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:24:03 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:24:03 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:24:03 user nova-compute[70709]: FIRMWARE:
Jul 28 00:24:03 user nova-compute[70709]: No targets found.
Jul 28 00:24:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:24:03 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:24:03 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1435d2b-2695-452d-9cce-df06329fd19a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.204s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25ba82c-9539-47d3-bbda-159d35337421]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:24:03 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:24:03 user nova-compute[70709]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:24:03 user nova-compute[70709]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:24:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:24:03 user nova-compute[70709]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a (non-flash)
Jul 28 00:24:03 user nova-compute[70709]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:24:03 user nova-compute[70709]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:24:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b8857c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a'): ({'sdc'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Removing single pathed devices sdc {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Successfully created port: c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8f41ee-8cfd-456e-96b4-94c036011103]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8120741f-3df7-4ace-8a3a-792d8133c908]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Flushing IO for device /dev/sdc {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "75132de4-0252-4bee-bb51-24602cc586ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "75132de4-0252-4bee-bb51-24602cc586ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:03 user nova-compute[70709]: INFO nova.compute.manager [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Terminating instance
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f480e9-2353-466e-a34d-00409c7a5760]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Cannot resize image /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lazy-loading 'migration_context' on Instance uuid 44753afd-489f-48fa-ae42-0abaf29c2306 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Ensure instance console log exists: /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[462da00c-f302-4722-b043-b6ae6c91e4aa]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3133abc4-b7cb-4950-ade0-42810b21381c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[919b27c1-5bac-41d6-87d8-315a27f3cad0]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260]
Jul 28 00:24:04 user nova-compute[70709]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a, portal: 172.16.0.220,3260] successful.
Jul 28 00:24:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8be09f2b-9c75-4381-8295-df8913d7878a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.126s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dfdcf6-9c68-4483-9e0a-b0678aeab9de]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.516s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] <== disconnect_volume: return (517ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-38992ef9-2f00-4a06-b4a7-f996c5bfd4c0 req-0bd77a6e-b3b9-4063-804c-87aabff1f5d5 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updated VIF entry in instance network info cache for port 65acb4df-b4f6-4c60-ae40-7c65e73fc335. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-38992ef9-2f00-4a06-b4a7-f996c5bfd4c0 req-0bd77a6e-b3b9-4063-804c-87aabff1f5d5 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updating instance_info_cache with network_info: [{"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-38992ef9-2f00-4a06-b4a7-f996c5bfd4c0 req-0bd77a6e-b3b9-4063-804c-87aabff1f5d5 service nova] Releasing lock "refresh_cache-30ac2ae7-04f8-407e-8aee-1c515b61d564" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:24:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Instance destroyed successfully.
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.objects.instance [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'resources' on Instance uuid 75132de4-0252-4bee-bb51-24602cc586ba {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1592643157',display_name='tempest-AttachVolumeNegativeTest-server-1592643157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1592643157',id=19,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5VpuERWBc3WeIkgcuWj6gddD6oaXM+Zo0aHnlJ836sZ+4ho5UZoH+zBLGB+Mb2nrt+Ya/ojlNitzOEs3MXei5OhA7geJ4Pbl9BqU0k5VNW7EKZGcDogP7/NKDGLJ0k2w==',key_name='tempest-keypair-351284796',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:21:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-zezjxndt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=75132de4-0252-4bee-bb51-24602cc586ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96ca7876-737c-4df3-ac1b-c778b5daae59", "address": "fa:16:3e:de:67:06", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ca7876-73", "ovs_interfaceid": "96ca7876-737c-4df3-ac1b-c778b5daae59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "96ca7876-737c-4df3-ac1b-c778b5daae59", "address": "fa:16:3e:de:67:06", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ca7876-73", "ovs_interfaceid": "96ca7876-737c-4df3-ac1b-c778b5daae59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:67:06,bridge_name='br-int',has_traffic_filtering=True,id=96ca7876-737c-4df3-ac1b-c778b5daae59,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ca7876-73') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG os_vif [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:67:06,bridge_name='br-int',has_traffic_filtering=True,id=96ca7876-737c-4df3-ac1b-c778b5daae59,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ca7876-73') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96ca7876-73, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:24:04 user nova-compute[70709]: INFO os_vif [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:67:06,bridge_name='br-int',has_traffic_filtering=True,id=96ca7876-737c-4df3-ac1b-c778b5daae59,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ca7876-73')
Jul 28 00:24:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Deleting instance files /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba_del
Jul 28 00:24:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Deletion of /opt/stack/data/nova/instances/75132de4-0252-4bee-bb51-24602cc586ba_del complete
Jul 28 00:24:04 user nova-compute[70709]: INFO nova.compute.manager [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Received event network-vif-unplugged-96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] Acquiring lock "75132de4-0252-4bee-bb51-24602cc586ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] Lock "75132de4-0252-4bee-bb51-24602cc586ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] Lock "75132de4-0252-4bee-bb51-24602cc586ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] No waiting events found dispatching network-vif-unplugged-96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Received event network-vif-unplugged-96ca7876-737c-4df3-ac1b-c778b5daae59 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Received event network-vif-plugged-96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] Acquiring lock "75132de4-0252-4bee-bb51-24602cc586ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] Lock "75132de4-0252-4bee-bb51-24602cc586ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] Lock "75132de4-0252-4bee-bb51-24602cc586ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] No waiting events found dispatching network-vif-plugged-96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:24:04 user nova-compute[70709]: WARNING nova.compute.manager [req-5062d4c0-e08a-4359-baa0-3a3c960a0100 req-f112acbc-f174-4044-b8ae-6dfc23aed8cc service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Received unexpected event network-vif-plugged-96ca7876-737c-4df3-ac1b-c778b5daae59 for instance with vm_state active and task_state deleting.
Jul 28 00:24:05 user nova-compute[70709]: DEBUG nova.objects.instance [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'flavor' on Instance uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:24:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-009950bd-090e-4e8f-a69a-5c938e1795e7 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.147s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:05 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Successfully updated port: c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:24:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "refresh_cache-44753afd-489f-48fa-ae42-0abaf29c2306" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:24:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquired lock "refresh_cache-44753afd-489f-48fa-ae42-0abaf29c2306" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:24:05 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:24:05 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:06 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Took 1.38 seconds to deallocate network for instance.
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-27de3c5f-8a22-4588-ba1e-a7354b1f3f7e req-ed8cfc74-548c-466a-9f41-b1c1cb5ab67f service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Received event network-vif-deleted-96ca7876-737c-4df3-ac1b-c778b5daae59 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:06 user nova-compute[70709]: INFO nova.compute.manager [req-27de3c5f-8a22-4588-ba1e-a7354b1f3f7e req-ed8cfc74-548c-466a-9f41-b1c1cb5ab67f service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Neutron deleted interface 96ca7876-737c-4df3-ac1b-c778b5daae59; detaching it from the instance and deleting it from the info cache
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.network.neutron [req-27de3c5f-8a22-4588-ba1e-a7354b1f3f7e req-ed8cfc74-548c-466a-9f41-b1c1cb5ab67f service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-27de3c5f-8a22-4588-ba1e-a7354b1f3f7e req-ed8cfc74-548c-466a-9f41-b1c1cb5ab67f service nova] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Detach interface failed, port_id=96ca7876-737c-4df3-ac1b-c778b5daae59, reason: Instance 75132de4-0252-4bee-bb51-24602cc586ba could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Updating instance_info_cache with network_info: [{"id": "c7268a6f-cb7b-47b4-892d-510883262188", "address": "fa:16:3e:95:2b:56", "network": {"id": "712dd33a-511a-44f9-9d06-baf14dd4651c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-18894966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a044df80e01435e82b533b6392d5ea8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7268a6f-cb", "ovs_interfaceid": "c7268a6f-cb7b-47b4-892d-510883262188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Releasing lock "refresh_cache-44753afd-489f-48fa-ae42-0abaf29c2306" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Instance network_info: |[{"id": "c7268a6f-cb7b-47b4-892d-510883262188", "address": "fa:16:3e:95:2b:56", "network": {"id": "712dd33a-511a-44f9-9d06-baf14dd4651c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-18894966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a044df80e01435e82b533b6392d5ea8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7268a6f-cb", "ovs_interfaceid": "c7268a6f-cb7b-47b4-892d-510883262188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Start _get_guest_xml network_info=[{"id": "c7268a6f-cb7b-47b4-892d-510883262188", "address": "fa:16:3e:95:2b:56", "network": {"id": "712dd33a-511a-44f9-9d06-baf14dd4651c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-18894966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a044df80e01435e82b533b6392d5ea8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7268a6f-cb", "ovs_interfaceid": "c7268a6f-cb7b-47b4-892d-510883262188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:24:06 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:24:06 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-174442115',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-174442115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1744421',id=24,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhS0DLdoRrjNsPWRKQM3/W37QhUr2bRgsoLA+rcHM8q9XNVa20uQjZf4FjRO2T/wZGK2JLUZx2yn4JR4ul9mx6JoFlgW5VeIZIYhfJa8bKYYDPDrnnKC+YTOyQ1DPjiHA==',key_name='tempest-keypair-1354676365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a044df80e01435e82b533b6392d5ea8',ramdisk_id='',reservation_id='r-3ppw6f79',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837516742',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f3572ab427249b28aabc681b29619fb',uuid=44753afd-489f-48fa-ae42-0abaf29c2306,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7268a6f-cb7b-47b4-892d-510883262188", "address": "fa:16:3e:95:2b:56", "network": {"id": "712dd33a-511a-44f9-9d06-baf14dd4651c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-18894966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a044df80e01435e82b533b6392d5ea8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7268a6f-cb", "ovs_interfaceid": "c7268a6f-cb7b-47b4-892d-510883262188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Converting VIF {"id": "c7268a6f-cb7b-47b4-892d-510883262188", "address": "fa:16:3e:95:2b:56", "network": {"id": "712dd33a-511a-44f9-9d06-baf14dd4651c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-18894966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a044df80e01435e82b533b6392d5ea8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7268a6f-cb", "ovs_interfaceid": "c7268a6f-cb7b-47b4-892d-510883262188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:2b:56,bridge_name='br-int',has_traffic_filtering=True,id=c7268a6f-cb7b-47b4-892d-510883262188,network=Network(712dd33a-511a-44f9-9d06-baf14dd4651c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7268a6f-cb') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.objects.instance [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lazy-loading 'pci_devices' on Instance uuid 44753afd-489f-48fa-ae42-0abaf29c2306 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:24:06 user nova-compute[70709]:   <uuid>44753afd-489f-48fa-ae42-0abaf29c2306</uuid>
Jul 28 00:24:06 user nova-compute[70709]:   <name>instance-00000018</name>
Jul 28 00:24:06 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:24:06 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:24:06 user nova-compute[70709]:   <metadata>
Jul 28 00:24:06 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:24:06 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:24:06 user nova-compute[70709]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-174442115</nova:name>
Jul 28 00:24:06 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:24:06</nova:creationTime>
Jul 28 00:24:06 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:24:06 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:24:06 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:24:06 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:24:06 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:24:06 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:24:06 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:24:06 user nova-compute[70709]:       <nova:owner>
Jul 28 00:24:06 user nova-compute[70709]:         <nova:user uuid="5f3572ab427249b28aabc681b29619fb">tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member</nova:user>
Jul 28 00:24:06 user nova-compute[70709]:         <nova:project uuid="1a044df80e01435e82b533b6392d5ea8">tempest-TestServerVolumeAttachScenarioOldVersion-1837516742</nova:project>
Jul 28 00:24:06 user nova-compute[70709]:       </nova:owner>
Jul 28 00:24:06 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:24:06 user nova-compute[70709]:       <nova:ports>
Jul 28 00:24:06 user nova-compute[70709]:         <nova:port uuid="c7268a6f-cb7b-47b4-892d-510883262188">
Jul 28 00:24:06 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 28 00:24:06 user nova-compute[70709]:         </nova:port>
Jul 28 00:24:06 user nova-compute[70709]:       </nova:ports>
Jul 28 00:24:06 user nova-compute[70709]:     </nova:instance>
Jul 28 00:24:06 user nova-compute[70709]:   </metadata>
Jul 28 00:24:06 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:24:06 user nova-compute[70709]:     <system>
Jul 28 00:24:06 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:24:06 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:24:06 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:24:06 user nova-compute[70709]:       <entry name="serial">44753afd-489f-48fa-ae42-0abaf29c2306</entry>
Jul 28 00:24:06 user nova-compute[70709]:       <entry name="uuid">44753afd-489f-48fa-ae42-0abaf29c2306</entry>
Jul 28 00:24:06 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:24:06 user nova-compute[70709]:     </system>
Jul 28 00:24:06 user nova-compute[70709]:   </sysinfo>
Jul 28 00:24:06 user nova-compute[70709]:   <os>
Jul 28 00:24:06 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:24:06 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:24:06 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:24:06 user nova-compute[70709]:   </os>
Jul 28 00:24:06 user nova-compute[70709]:   <features>
Jul 28 00:24:06 user nova-compute[70709]:     <acpi/>
Jul 28 00:24:06 user nova-compute[70709]:     <apic/>
Jul 28 00:24:06 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:24:06 user nova-compute[70709]:   </features>
Jul 28 00:24:06 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:24:06 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:24:06 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:24:06 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:24:06 user nova-compute[70709]:   </clock>
Jul 28 00:24:06 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:24:06 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:24:06 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:24:06 user nova-compute[70709]:   </cpu>
Jul 28 00:24:06 user nova-compute[70709]:   <devices>
Jul 28 00:24:06 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:24:06 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:24:06 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk"/>
Jul 28 00:24:06 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:24:06 user nova-compute[70709]:     </disk>
Jul 28 00:24:06 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:24:06 user nova-compute[70709]:       <mac address="fa:16:3e:95:2b:56"/>
Jul 28 00:24:06 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:24:06 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:24:06 user nova-compute[70709]:       <target dev="tapc7268a6f-cb"/>
Jul 28 00:24:06 user nova-compute[70709]:     </interface>
Jul 28 00:24:06 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:24:06 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/console.log" append="off"/>
Jul 28 00:24:06 user nova-compute[70709]:     </serial>
Jul 28 00:24:06 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:24:06 user nova-compute[70709]:     <video>
Jul 28 00:24:06 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:24:06 user nova-compute[70709]:     </video>
Jul 28 00:24:06 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:24:06 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:24:06 user nova-compute[70709]:     </rng>
Jul 28 00:24:06 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:24:06 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:24:06 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:24:06 user nova-compute[70709]:     </memballoon>
Jul 28 00:24:06 user nova-compute[70709]:   </devices>
Jul 28 00:24:06 user nova-compute[70709]: </domain>
Jul 28 00:24:06 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-174442115',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-174442115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1744421',id=24,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhS0DLdoRrjNsPWRKQM3/W37QhUr2bRgsoLA+rcHM8q9XNVa20uQjZf4FjRO2T/wZGK2JLUZx2yn4JR4ul9mx6JoFlgW5VeIZIYhfJa8bKYYDPDrnnKC+YTOyQ1DPjiHA==',key_name='tempest-keypair-1354676365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a044df80e01435e82b533b6392d5ea8',ramdisk_id='',reservation_id='r-3ppw6f79',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837516742',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f3572ab427249b28aabc681b29619fb',uuid=44753afd-489f-48fa-ae42-0abaf29c2306,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7268a6f-cb7b-47b4-892d-510883262188", "address": "fa:16:3e:95:2b:56", "network": {"id": "712dd33a-511a-44f9-9d06-baf14dd4651c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-18894966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a044df80e01435e82b533b6392d5ea8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7268a6f-cb", "ovs_interfaceid": "c7268a6f-cb7b-47b4-892d-510883262188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Converting VIF {"id": "c7268a6f-cb7b-47b4-892d-510883262188", "address": "fa:16:3e:95:2b:56", "network": {"id": "712dd33a-511a-44f9-9d06-baf14dd4651c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-18894966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a044df80e01435e82b533b6392d5ea8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7268a6f-cb", "ovs_interfaceid": "c7268a6f-cb7b-47b4-892d-510883262188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:2b:56,bridge_name='br-int',has_traffic_filtering=True,id=c7268a6f-cb7b-47b4-892d-510883262188,network=Network(712dd33a-511a-44f9-9d06-baf14dd4651c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7268a6f-cb') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG os_vif [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:2b:56,bridge_name='br-int',has_traffic_filtering=True,id=c7268a6f-cb7b-47b4-892d-510883262188,network=Network(712dd33a-511a-44f9-9d06-baf14dd4651c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7268a6f-cb') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7268a6f-cb, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7268a6f-cb, col_values=(('external_ids', {'iface-id': 'c7268a6f-cb7b-47b4-892d-510883262188', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:2b:56', 'vm-uuid': '44753afd-489f-48fa-ae42-0abaf29c2306'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:06 user nova-compute[70709]: INFO os_vif [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:2b:56,bridge_name='br-int',has_traffic_filtering=True,id=c7268a6f-cb7b-47b4-892d-510883262188,network=Network(712dd33a-511a-44f9-9d06-baf14dd4651c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7268a6f-cb')
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] No VIF found with MAC fa:16:3e:95:2b:56, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.514s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:06 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Deleted allocations for instance 75132de4-0252-4bee-bb51-24602cc586ba
Jul 28 00:24:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-28044252-3ed2-4aad-b969-5fd4732064bd tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "75132de4-0252-4bee-bb51-24602cc586ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.042s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-77820e23-d414-4111-be67-b0c82f534319 req-63d2704b-a834-4f62-80ee-2993420edc40 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Received event network-changed-c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-77820e23-d414-4111-be67-b0c82f534319 req-63d2704b-a834-4f62-80ee-2993420edc40 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Refreshing instance network info cache due to event network-changed-c7268a6f-cb7b-47b4-892d-510883262188. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-77820e23-d414-4111-be67-b0c82f534319 req-63d2704b-a834-4f62-80ee-2993420edc40 service nova] Acquiring lock "refresh_cache-44753afd-489f-48fa-ae42-0abaf29c2306" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-77820e23-d414-4111-be67-b0c82f534319 req-63d2704b-a834-4f62-80ee-2993420edc40 service nova] Acquired lock "refresh_cache-44753afd-489f-48fa-ae42-0abaf29c2306" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:24:06 user nova-compute[70709]: DEBUG nova.network.neutron [req-77820e23-d414-4111-be67-b0c82f534319 req-63d2704b-a834-4f62-80ee-2993420edc40 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Refreshing network info cache for port c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:24:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:07 user nova-compute[70709]: DEBUG nova.network.neutron [req-77820e23-d414-4111-be67-b0c82f534319 req-63d2704b-a834-4f62-80ee-2993420edc40 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Updated VIF entry in instance network info cache for port c7268a6f-cb7b-47b4-892d-510883262188. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:24:07 user nova-compute[70709]: DEBUG nova.network.neutron [req-77820e23-d414-4111-be67-b0c82f534319 req-63d2704b-a834-4f62-80ee-2993420edc40 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Updating instance_info_cache with network_info: [{"id": "c7268a6f-cb7b-47b4-892d-510883262188", "address": "fa:16:3e:95:2b:56", "network": {"id": "712dd33a-511a-44f9-9d06-baf14dd4651c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-18894966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a044df80e01435e82b533b6392d5ea8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7268a6f-cb", "ovs_interfaceid": "c7268a6f-cb7b-47b4-892d-510883262188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-77820e23-d414-4111-be67-b0c82f534319 req-63d2704b-a834-4f62-80ee-2993420edc40 service nova] Releasing lock "refresh_cache-44753afd-489f-48fa-ae42-0abaf29c2306" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:24:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-8550c08b-079a-498f-b1c9-105102b0ca07 req-c9a3f044-515e-4ef8-b18c-bd06808f717b service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Received event network-vif-plugged-c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8550c08b-079a-498f-b1c9-105102b0ca07 req-c9a3f044-515e-4ef8-b18c-bd06808f717b service nova] Acquiring lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8550c08b-079a-498f-b1c9-105102b0ca07 req-c9a3f044-515e-4ef8-b18c-bd06808f717b service nova] Lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8550c08b-079a-498f-b1c9-105102b0ca07 req-c9a3f044-515e-4ef8-b18c-bd06808f717b service nova] Lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-8550c08b-079a-498f-b1c9-105102b0ca07 req-c9a3f044-515e-4ef8-b18c-bd06808f717b service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] No waiting events found dispatching network-vif-plugged-c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:24:08 user nova-compute[70709]: WARNING nova.compute.manager [req-8550c08b-079a-498f-b1c9-105102b0ca07 req-c9a3f044-515e-4ef8-b18c-bd06808f717b service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Received unexpected event network-vif-plugged-c7268a6f-cb7b-47b4-892d-510883262188 for instance with vm_state building and task_state spawning.
Jul 28 00:24:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-1bc27a45-34df-4bde-a0de-bd058f100063 req-64b3e420-f94d-4848-a773-1493ccb2c132 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Received event network-vif-plugged-c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1bc27a45-34df-4bde-a0de-bd058f100063 req-64b3e420-f94d-4848-a773-1493ccb2c132 service nova] Acquiring lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1bc27a45-34df-4bde-a0de-bd058f100063 req-64b3e420-f94d-4848-a773-1493ccb2c132 service nova] Lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1bc27a45-34df-4bde-a0de-bd058f100063 req-64b3e420-f94d-4848-a773-1493ccb2c132 service nova] Lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-1bc27a45-34df-4bde-a0de-bd058f100063 req-64b3e420-f94d-4848-a773-1493ccb2c132 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] No waiting events found dispatching network-vif-plugged-c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:24:10 user nova-compute[70709]: WARNING nova.compute.manager [req-1bc27a45-34df-4bde-a0de-bd058f100063 req-64b3e420-f94d-4848-a773-1493ccb2c132 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Received unexpected event network-vif-plugged-c7268a6f-cb7b-47b4-892d-510883262188 for instance with vm_state building and task_state spawning.
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503850.2970204, 44753afd-489f-48fa-ae42-0abaf29c2306 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:24:10 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] VM Resumed (Lifecycle Event)
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:24:10 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Instance spawned successfully.
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:10 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503850.300492, 44753afd-489f-48fa-ae42-0abaf29c2306 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:24:10 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] VM Started (Lifecycle Event)
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:24:10 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:24:10 user nova-compute[70709]: INFO nova.compute.manager [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Took 7.36 seconds to spawn the instance on the hypervisor.
Jul 28 00:24:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:24:10 user nova-compute[70709]: INFO nova.compute.manager [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Took 8.50 seconds to build instance.
Jul 28 00:24:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25a44cac-8b56-409a-9ae8-f978f693cecd tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.669s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:24:13 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:24:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:13 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503839.6123638, 2bb828f4-bb7d-4754-bcaa-38f2954b8eee => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:24:14 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] VM Stopped (Lifecycle Event)
Jul 28 00:24:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-1fc9823f-6f31-476a-8360-6b27192fa0f6 None None] [instance: 2bb828f4-bb7d-4754-bcaa-38f2954b8eee] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:24:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:24:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:24:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:24:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7408MB free_disk=25.330318450927734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:24:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 8168aa39-afce-4c9e-ba76-78a760767357 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance c6297718-d595-4657-aa32-aa75bffdf955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 30ac2ae7-04f8-407e-8aee-1c515b61d564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 552ba43b-6f39-4a9d-a93e-bb2831324d01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b451d103-db00-4cea-86ed-d23cab6120f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 44753afd-489f-48fa-ae42-0abaf29c2306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:24:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:24:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:24:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:24:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:24:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:24:19 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503844.6232343, 75132de4-0252-4bee-bb51-24602cc586ba => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:24:19 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] VM Stopped (Lifecycle Event)
Jul 28 00:24:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-048a5582-f92c-4f56-945d-665eafe5ab62 None None] [instance: 75132de4-0252-4bee-bb51-24602cc586ba] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:24:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:20 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:24:20 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:24:21 user nova-compute[70709]: INFO nova.compute.claims [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Claim successful on node user
Jul 28 00:24:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updating instance_info_cache with network_info: [{"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:24:21 user nova-compute[70709]: DEBUG nova.network.neutron [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:24:21 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:24:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG nova.policy [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3328a16a9f1f4311899b091ce8412ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96d74828e1479381106c4c6538ea78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG nova.compute.manager [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:24:22 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Creating image(s)
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "/opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "/opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "/opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk 1073741824" returned: 0 in 0.057s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Checking if we can resize image /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG nova.network.neutron [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Successfully created port: 4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Cannot resize image /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG nova.objects.instance [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lazy-loading 'migration_context' on Instance uuid 773cf3d1-e98d-4002-bb1f-a3b33a36edac {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Ensure instance console log exists: /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Successfully updated port: 4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:24:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:24:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "refresh_cache-773cf3d1-e98d-4002-bb1f-a3b33a36edac" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:24:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquired lock "refresh_cache-773cf3d1-e98d-4002-bb1f-a3b33a36edac" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:24:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:24:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-5bb88095-2044-4562-96ba-93d90f857123 req-74d72a81-c7c4-4a69-8578-fbf094536cbb service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received event network-changed-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-5bb88095-2044-4562-96ba-93d90f857123 req-74d72a81-c7c4-4a69-8578-fbf094536cbb service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Refreshing instance network info cache due to event network-changed-4bb6e5ed-40d9-4724-b67c-9463bf00708f. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:24:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5bb88095-2044-4562-96ba-93d90f857123 req-74d72a81-c7c4-4a69-8578-fbf094536cbb service nova] Acquiring lock "refresh_cache-773cf3d1-e98d-4002-bb1f-a3b33a36edac" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:24:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:24:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:24:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Updating instance_info_cache with network_info: [{"id": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "address": "fa:16:3e:d5:1b:29", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb6e5ed-40", "ovs_interfaceid": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Releasing lock "refresh_cache-773cf3d1-e98d-4002-bb1f-a3b33a36edac" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Instance network_info: |[{"id": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "address": "fa:16:3e:d5:1b:29", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb6e5ed-40", "ovs_interfaceid": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5bb88095-2044-4562-96ba-93d90f857123 req-74d72a81-c7c4-4a69-8578-fbf094536cbb service nova] Acquired lock "refresh_cache-773cf3d1-e98d-4002-bb1f-a3b33a36edac" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.network.neutron [req-5bb88095-2044-4562-96ba-93d90f857123 req-74d72a81-c7c4-4a69-8578-fbf094536cbb service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Refreshing network info cache for port 4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Start _get_guest_xml network_info=[{"id": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "address": "fa:16:3e:d5:1b:29", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb6e5ed-40", "ovs_interfaceid": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:24:24 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:24:24 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-68901665',display_name='tempest-ServersNegativeTestJSON-server-68901665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-68901665',id=25,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c96d74828e1479381106c4c6538ea78',ramdisk_id='',reservation_id='r-gxuec1lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-969661376',owner_user_name='tempest-ServersNegativeTestJSON-969661376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:24:22Z,user_data=None,user_id='3328a16a9f1f4311899b091ce8412ba5',uuid=773cf3d1-e98d-4002-bb1f-a3b33a36edac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "address": "fa:16:3e:d5:1b:29", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb6e5ed-40", "ovs_interfaceid": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converting VIF {"id": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "address": "fa:16:3e:d5:1b:29", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb6e5ed-40", "ovs_interfaceid": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=4bb6e5ed-40d9-4724-b67c-9463bf00708f,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb6e5ed-40') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.objects.instance [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lazy-loading 'pci_devices' on Instance uuid 773cf3d1-e98d-4002-bb1f-a3b33a36edac {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:24:24 user nova-compute[70709]:   <uuid>773cf3d1-e98d-4002-bb1f-a3b33a36edac</uuid>
Jul 28 00:24:24 user nova-compute[70709]:   <name>instance-00000019</name>
Jul 28 00:24:24 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:24:24 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:24:24 user nova-compute[70709]:   <metadata>
Jul 28 00:24:24 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:24:24 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:24:24 user nova-compute[70709]:       <nova:name>tempest-ServersNegativeTestJSON-server-68901665</nova:name>
Jul 28 00:24:24 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:24:24</nova:creationTime>
Jul 28 00:24:24 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:24:24 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:24:24 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:24:24 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:24:24 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:24:24 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:24:24 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:24:24 user nova-compute[70709]:       <nova:owner>
Jul 28 00:24:24 user nova-compute[70709]:         <nova:user uuid="3328a16a9f1f4311899b091ce8412ba5">tempest-ServersNegativeTestJSON-969661376-project-member</nova:user>
Jul 28 00:24:24 user nova-compute[70709]:         <nova:project uuid="5c96d74828e1479381106c4c6538ea78">tempest-ServersNegativeTestJSON-969661376</nova:project>
Jul 28 00:24:24 user nova-compute[70709]:       </nova:owner>
Jul 28 00:24:24 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:24:24 user nova-compute[70709]:       <nova:ports>
Jul 28 00:24:24 user nova-compute[70709]:         <nova:port uuid="4bb6e5ed-40d9-4724-b67c-9463bf00708f">
Jul 28 00:24:24 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 28 00:24:24 user nova-compute[70709]:         </nova:port>
Jul 28 00:24:24 user nova-compute[70709]:       </nova:ports>
Jul 28 00:24:24 user nova-compute[70709]:     </nova:instance>
Jul 28 00:24:24 user nova-compute[70709]:   </metadata>
Jul 28 00:24:24 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:24:24 user nova-compute[70709]:     <system>
Jul 28 00:24:24 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:24:24 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:24:24 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:24:24 user nova-compute[70709]:       <entry name="serial">773cf3d1-e98d-4002-bb1f-a3b33a36edac</entry>
Jul 28 00:24:24 user nova-compute[70709]:       <entry name="uuid">773cf3d1-e98d-4002-bb1f-a3b33a36edac</entry>
Jul 28 00:24:24 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:24:24 user nova-compute[70709]:     </system>
Jul 28 00:24:24 user nova-compute[70709]:   </sysinfo>
Jul 28 00:24:24 user nova-compute[70709]:   <os>
Jul 28 00:24:24 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:24:24 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:24:24 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:24:24 user nova-compute[70709]:   </os>
Jul 28 00:24:24 user nova-compute[70709]:   <features>
Jul 28 00:24:24 user nova-compute[70709]:     <acpi/>
Jul 28 00:24:24 user nova-compute[70709]:     <apic/>
Jul 28 00:24:24 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:24:24 user nova-compute[70709]:   </features>
Jul 28 00:24:24 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:24:24 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:24:24 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:24:24 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:24:24 user nova-compute[70709]:   </clock>
Jul 28 00:24:24 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:24:24 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:24:24 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:24:24 user nova-compute[70709]:   </cpu>
Jul 28 00:24:24 user nova-compute[70709]:   <devices>
Jul 28 00:24:24 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:24:24 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:24:24 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk"/>
Jul 28 00:24:24 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:24:24 user nova-compute[70709]:     </disk>
Jul 28 00:24:24 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:24:24 user nova-compute[70709]:       <mac address="fa:16:3e:d5:1b:29"/>
Jul 28 00:24:24 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:24:24 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:24:24 user nova-compute[70709]:       <target dev="tap4bb6e5ed-40"/>
Jul 28 00:24:24 user nova-compute[70709]:     </interface>
Jul 28 00:24:24 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:24:24 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/console.log" append="off"/>
Jul 28 00:24:24 user nova-compute[70709]:     </serial>
Jul 28 00:24:24 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:24:24 user nova-compute[70709]:     <video>
Jul 28 00:24:24 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:24:24 user nova-compute[70709]:     </video>
Jul 28 00:24:24 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:24:24 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:24:24 user nova-compute[70709]:     </rng>
Jul 28 00:24:24 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:24:24 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:24:24 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:24:24 user nova-compute[70709]:     </memballoon>
Jul 28 00:24:24 user nova-compute[70709]:   </devices>
Jul 28 00:24:24 user nova-compute[70709]: </domain>
Jul 28 00:24:24 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-68901665',display_name='tempest-ServersNegativeTestJSON-server-68901665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-68901665',id=25,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c96d74828e1479381106c4c6538ea78',ramdisk_id='',reservation_id='r-gxuec1lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-969661376',owner_user_name='tempest-ServersNegativeTestJSON-969661376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:24:22Z,user_data=None,user_id='3328a16a9f1f4311899b091ce8412ba5',uuid=773cf3d1-e98d-4002-bb1f-a3b33a36edac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "address": "fa:16:3e:d5:1b:29", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb6e5ed-40", "ovs_interfaceid": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converting VIF {"id": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "address": "fa:16:3e:d5:1b:29", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb6e5ed-40", "ovs_interfaceid": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=4bb6e5ed-40d9-4724-b67c-9463bf00708f,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb6e5ed-40') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG os_vif [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=4bb6e5ed-40d9-4724-b67c-9463bf00708f,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb6e5ed-40') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bb6e5ed-40, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bb6e5ed-40, col_values=(('external_ids', {'iface-id': '4bb6e5ed-40d9-4724-b67c-9463bf00708f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:1b:29', 'vm-uuid': '773cf3d1-e98d-4002-bb1f-a3b33a36edac'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:24 user nova-compute[70709]: INFO os_vif [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=4bb6e5ed-40d9-4724-b67c-9463bf00708f,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb6e5ed-40')
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] No VIF found with MAC fa:16:3e:d5:1b:29, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.network.neutron [req-5bb88095-2044-4562-96ba-93d90f857123 req-74d72a81-c7c4-4a69-8578-fbf094536cbb service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Updated VIF entry in instance network info cache for port 4bb6e5ed-40d9-4724-b67c-9463bf00708f. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG nova.network.neutron [req-5bb88095-2044-4562-96ba-93d90f857123 req-74d72a81-c7c4-4a69-8578-fbf094536cbb service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Updating instance_info_cache with network_info: [{"id": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "address": "fa:16:3e:d5:1b:29", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb6e5ed-40", "ovs_interfaceid": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5bb88095-2044-4562-96ba-93d90f857123 req-74d72a81-c7c4-4a69-8578-fbf094536cbb service nova] Releasing lock "refresh_cache-773cf3d1-e98d-4002-bb1f-a3b33a36edac" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:24:24 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:24:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-64830c61-ac96-4b20-831d-f0298d767acd req-b5fd7049-62ad-4a9b-acaa-6ac4d79dd68b service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received event network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-64830c61-ac96-4b20-831d-f0298d767acd req-b5fd7049-62ad-4a9b-acaa-6ac4d79dd68b service nova] Acquiring lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-64830c61-ac96-4b20-831d-f0298d767acd req-b5fd7049-62ad-4a9b-acaa-6ac4d79dd68b service nova] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-64830c61-ac96-4b20-831d-f0298d767acd req-b5fd7049-62ad-4a9b-acaa-6ac4d79dd68b service nova] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-64830c61-ac96-4b20-831d-f0298d767acd req-b5fd7049-62ad-4a9b-acaa-6ac4d79dd68b service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] No waiting events found dispatching network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:24:25 user nova-compute[70709]: WARNING nova.compute.manager [req-64830c61-ac96-4b20-831d-f0298d767acd req-b5fd7049-62ad-4a9b-acaa-6ac4d79dd68b service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received unexpected event network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f for instance with vm_state building and task_state spawning.
Jul 28 00:24:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503867.7612453, 773cf3d1-e98d-4002-bb1f-a3b33a36edac => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:24:27 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] VM Resumed (Lifecycle Event)
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:24:27 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Instance spawned successfully.
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:24:27 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503867.765581, 773cf3d1-e98d-4002-bb1f-a3b33a36edac => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:24:27 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] VM Started (Lifecycle Event)
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:24:27 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:24:27 user nova-compute[70709]: INFO nova.compute.manager [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Took 5.80 seconds to spawn the instance on the hypervisor.
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:24:27 user nova-compute[70709]: INFO nova.compute.manager [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Took 6.69 seconds to build instance.
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-966499e0-e172-4aba-85ff-c78c1e8a3d21 req-b83d3cc2-4a75-47bb-96b3-1d27dbb96a81 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received event network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-966499e0-e172-4aba-85ff-c78c1e8a3d21 req-b83d3cc2-4a75-47bb-96b3-1d27dbb96a81 service nova] Acquiring lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-966499e0-e172-4aba-85ff-c78c1e8a3d21 req-b83d3cc2-4a75-47bb-96b3-1d27dbb96a81 service nova] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-966499e0-e172-4aba-85ff-c78c1e8a3d21 req-b83d3cc2-4a75-47bb-96b3-1d27dbb96a81 service nova] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-966499e0-e172-4aba-85ff-c78c1e8a3d21 req-b83d3cc2-4a75-47bb-96b3-1d27dbb96a81 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] No waiting events found dispatching network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:24:27 user nova-compute[70709]: WARNING nova.compute.manager [req-966499e0-e172-4aba-85ff-c78c1e8a3d21 req-b83d3cc2-4a75-47bb-96b3-1d27dbb96a81 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received unexpected event network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f for instance with vm_state active and task_state None.
Jul 28 00:24:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-615824d4-c541-4779-b9a6-af551ac646d1 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.784s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "8168aa39-afce-4c9e-ba76-78a760767357" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "8168aa39-afce-4c9e-ba76-78a760767357-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:30 user nova-compute[70709]: INFO nova.compute.manager [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Terminating instance
Jul 28 00:24:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-e7df0dc6-f5e0-49d7-92f5-3dfa9e90c44d req-9f8ce5cf-a714-4afd-ab9d-787add98636e service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Received event network-vif-unplugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e7df0dc6-f5e0-49d7-92f5-3dfa9e90c44d req-9f8ce5cf-a714-4afd-ab9d-787add98636e service nova] Acquiring lock "8168aa39-afce-4c9e-ba76-78a760767357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e7df0dc6-f5e0-49d7-92f5-3dfa9e90c44d req-9f8ce5cf-a714-4afd-ab9d-787add98636e service nova] Lock "8168aa39-afce-4c9e-ba76-78a760767357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e7df0dc6-f5e0-49d7-92f5-3dfa9e90c44d req-9f8ce5cf-a714-4afd-ab9d-787add98636e service nova] Lock "8168aa39-afce-4c9e-ba76-78a760767357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-e7df0dc6-f5e0-49d7-92f5-3dfa9e90c44d req-9f8ce5cf-a714-4afd-ab9d-787add98636e service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] No waiting events found dispatching network-vif-unplugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-e7df0dc6-f5e0-49d7-92f5-3dfa9e90c44d req-9f8ce5cf-a714-4afd-ab9d-787add98636e service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Received event network-vif-unplugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:24:31 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Instance destroyed successfully.
Jul 28 00:24:31 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lazy-loading 'resources' on Instance uuid 8168aa39-afce-4c9e-ba76-78a760767357 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-112387795',display_name='tempest-VolumesAdminNegativeTest-server-112387795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-112387795',id=15,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvxeCpoXyL4L/QGhEY0hwn6ca64Hgg+xkpCkOoFCbEILR2mSCAw20ll9UF+zLLNy3TqdK4RBtK9fzupjseRBhV7tRR33zFBMFP0a22zV0z999om01KaPV7ZDDB7fpLnKg==',key_name='tempest-keypair-263863682',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1181361da7694becb7e59b4b47eb0760',ramdisk_id='',reservation_id='r-im8d98vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-945099691',owner_user_name='tempest-VolumesAdminNegativeTest-945099691-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:18:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1ee7cb9ed044e10a022b23f51bcb588',uuid=8168aa39-afce-4c9e-ba76-78a760767357,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "address": "fa:16:3e:41:8c:f9", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a39ad7-b4", "ovs_interfaceid": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converting VIF {"id": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "address": "fa:16:3e:41:8c:f9", "network": {"id": "3c091654-4fd1-46be-9c30-1b29fe868fba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1714173986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1181361da7694becb7e59b4b47eb0760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a39ad7-b4", "ovs_interfaceid": "b3a39ad7-b4fb-42f8-afc2-038ad99f2f47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:8c:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3a39ad7-b4fb-42f8-afc2-038ad99f2f47,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a39ad7-b4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG os_vif [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:8c:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3a39ad7-b4fb-42f8-afc2-038ad99f2f47,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a39ad7-b4') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3a39ad7-b4, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:31 user nova-compute[70709]: INFO os_vif [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:8c:f9,bridge_name='br-int',has_traffic_filtering=True,id=b3a39ad7-b4fb-42f8-afc2-038ad99f2f47,network=Network(3c091654-4fd1-46be-9c30-1b29fe868fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a39ad7-b4')
Jul 28 00:24:31 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Deleting instance files /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357_del
Jul 28 00:24:31 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Deletion of /opt/stack/data/nova/instances/8168aa39-afce-4c9e-ba76-78a760767357_del complete
Jul 28 00:24:31 user nova-compute[70709]: INFO nova.compute.manager [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 28 00:24:31 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:24:31 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:24:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:33 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:33 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Took 1.25 seconds to deallocate network for instance.
Jul 28 00:24:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-ca48f738-1783-47db-b7a9-556a55427fb8 req-51d658ed-7ae2-4d4c-be54-0a4e562396e8 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Received event network-vif-plugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ca48f738-1783-47db-b7a9-556a55427fb8 req-51d658ed-7ae2-4d4c-be54-0a4e562396e8 service nova] Acquiring lock "8168aa39-afce-4c9e-ba76-78a760767357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ca48f738-1783-47db-b7a9-556a55427fb8 req-51d658ed-7ae2-4d4c-be54-0a4e562396e8 service nova] Lock "8168aa39-afce-4c9e-ba76-78a760767357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ca48f738-1783-47db-b7a9-556a55427fb8 req-51d658ed-7ae2-4d4c-be54-0a4e562396e8 service nova] Lock "8168aa39-afce-4c9e-ba76-78a760767357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-ca48f738-1783-47db-b7a9-556a55427fb8 req-51d658ed-7ae2-4d4c-be54-0a4e562396e8 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] No waiting events found dispatching network-vif-plugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:24:33 user nova-compute[70709]: WARNING nova.compute.manager [req-ca48f738-1783-47db-b7a9-556a55427fb8 req-51d658ed-7ae2-4d4c-be54-0a4e562396e8 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Received unexpected event network-vif-plugged-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 for instance with vm_state deleted and task_state None.
Jul 28 00:24:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-ca48f738-1783-47db-b7a9-556a55427fb8 req-51d658ed-7ae2-4d4c-be54-0a4e562396e8 service nova] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Received event network-vif-deleted-b3a39ad7-b4fb-42f8-afc2-038ad99f2f47 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:33 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:24:33 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:24:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:33 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Deleted allocations for instance 8168aa39-afce-4c9e-ba76-78a760767357
Jul 28 00:24:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af560d6-5694-46bf-883a-0df2c992e24f tempest-VolumesAdminNegativeTest-945099691 tempest-VolumesAdminNegativeTest-945099691-project-member] Lock "8168aa39-afce-4c9e-ba76-78a760767357" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.857s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:46 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503871.7596781, 8168aa39-afce-4c9e-ba76-78a760767357 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:24:46 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] VM Stopped (Lifecycle Event)
Jul 28 00:24:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-35212aaf-62bb-48fb-aebe-d2cff705454a None None] [instance: 8168aa39-afce-4c9e-ba76-78a760767357] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:24:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:24:50 user nova-compute[70709]: INFO nova.compute.manager [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] instance snapshotting
Jul 28 00:24:50 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Beginning live snapshot process
Jul 28 00:24:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json -f qcow2 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json -f qcow2 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoaabb67h/ad589a74b509414c8b16c99a9d45af88.delta 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:51 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoaabb67h/ad589a74b509414c8b16c99a9d45af88.delta 1073741824" returned: 0 in 0.058s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:51 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 28 00:24:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:24:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] COPY block job progress, current cursor: 75366400 final cursor: 75497472 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:24:53 user nova-compute[70709]: INFO nova.compute.claims [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Claim successful on node user
Jul 28 00:24:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:24:53 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 28 00:24:53 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoaabb67h/ad589a74b509414c8b16c99a9d45af88.delta /opt/stack/data/nova/instances/snapshots/tmpoaabb67h/ad589a74b509414c8b16c99a9d45af88 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoaabb67h/ad589a74b509414c8b16c99a9d45af88.delta /opt/stack/data/nova/instances/snapshots/tmpoaabb67h/ad589a74b509414c8b16c99a9d45af88" returned: 0 in 0.325s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:53 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Snapshot extracted, beginning image upload
Jul 28 00:24:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:24:53 user nova-compute[70709]: DEBUG nova.network.neutron [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:24:53 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:24:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG nova.policy [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c3a7c37bbe542008221fd2bcaf18f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7063760e8f3340f88a0505a3cdcdbf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:24:54 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Creating image(s)
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "/opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "/opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "/opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.179s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.196s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk 1073741824" returned: 0 in 0.058s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Cannot resize image /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:24:54 user nova-compute[70709]: DEBUG nova.objects.instance [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'migration_context' on Instance uuid 779ac3df-ee2f-49a2-bb03-1a162eed34b0 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:24:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:24:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Ensure instance console log exists: /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:24:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:55 user nova-compute[70709]: DEBUG nova.network.neutron [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Successfully created port: ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:24:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:55 user nova-compute[70709]: INFO nova.compute.manager [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Terminating instance
Jul 28 00:24:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.network.neutron [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Successfully updated port: ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "refresh_cache-779ac3df-ee2f-49a2-bb03-1a162eed34b0" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquired lock "refresh_cache-779ac3df-ee2f-49a2-bb03-1a162eed34b0" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.network.neutron [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.network.neutron [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-85b95f45-5ad0-46bb-bf66-ec27bdb460a5 req-ba2dd0d2-3e8c-42bc-a9c9-b7d70e4be240 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Received event network-changed-ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-85b95f45-5ad0-46bb-bf66-ec27bdb460a5 req-ba2dd0d2-3e8c-42bc-a9c9-b7d70e4be240 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Refreshing instance network info cache due to event network-changed-ef4e9d67-7edd-45d8-93a2-6386992bbe38. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-85b95f45-5ad0-46bb-bf66-ec27bdb460a5 req-ba2dd0d2-3e8c-42bc-a9c9-b7d70e4be240 service nova] Acquiring lock "refresh_cache-779ac3df-ee2f-49a2-bb03-1a162eed34b0" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-4a2097ff-c7f5-4af7-a803-47735df180a5 req-6e30dd22-e222-4097-a4b4-01ce40781d7a service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-vif-unplugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4a2097ff-c7f5-4af7-a803-47735df180a5 req-6e30dd22-e222-4097-a4b4-01ce40781d7a service nova] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4a2097ff-c7f5-4af7-a803-47735df180a5 req-6e30dd22-e222-4097-a4b4-01ce40781d7a service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4a2097ff-c7f5-4af7-a803-47735df180a5 req-6e30dd22-e222-4097-a4b4-01ce40781d7a service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-4a2097ff-c7f5-4af7-a803-47735df180a5 req-6e30dd22-e222-4097-a4b4-01ce40781d7a service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] No waiting events found dispatching network-vif-unplugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-4a2097ff-c7f5-4af7-a803-47735df180a5 req-6e30dd22-e222-4097-a4b4-01ce40781d7a service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-vif-unplugged-3bf19206-8843-4662-a147-edec46431a9b for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.network.neutron [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Updating instance_info_cache with network_info: [{"id": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "address": "fa:16:3e:79:18:f5", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e9d67-7e", "ovs_interfaceid": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Releasing lock "refresh_cache-779ac3df-ee2f-49a2-bb03-1a162eed34b0" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Instance network_info: |[{"id": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "address": "fa:16:3e:79:18:f5", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e9d67-7e", "ovs_interfaceid": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-85b95f45-5ad0-46bb-bf66-ec27bdb460a5 req-ba2dd0d2-3e8c-42bc-a9c9-b7d70e4be240 service nova] Acquired lock "refresh_cache-779ac3df-ee2f-49a2-bb03-1a162eed34b0" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.network.neutron [req-85b95f45-5ad0-46bb-bf66-ec27bdb460a5 req-ba2dd0d2-3e8c-42bc-a9c9-b7d70e4be240 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Refreshing network info cache for port ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Start _get_guest_xml network_info=[{"id": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "address": "fa:16:3e:79:18:f5", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e9d67-7e", "ovs_interfaceid": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:24:56 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:24:56 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Instance destroyed successfully.
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lazy-loading 'resources' on Instance uuid 552ba43b-6f39-4a9d-a93e-bb2831324d01 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-351485996',display_name='tempest-AttachVolumeTestJSON-server-351485996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-351485996',id=26,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzSfZ6wRq06WNCWcdZJMRzozsDKoM7q2zH2vBqFVLmht1oKEN3dxAmPdwsv2p4K7T3eoGwbcDsFmpO0an/9/9yasb08wlPOPQcSvszJ4OZ+bwpId66smPFlv3jbuIsJEA==',key_name='tempest-keypair-1369163009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-3ydntjp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=779ac3df-ee2f-49a2-bb03-1a162eed34b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "address": "fa:16:3e:79:18:f5", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e9d67-7e", "ovs_interfaceid": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "address": "fa:16:3e:79:18:f5", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e9d67-7e", "ovs_interfaceid": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:18:f5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e9d67-7edd-45d8-93a2-6386992bbe38,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e9d67-7e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.objects.instance [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'pci_devices' on Instance uuid 779ac3df-ee2f-49a2-bb03-1a162eed34b0 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T00:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-260409921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1150596554',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTphqF5bcF3n3OoMRDgsPxmVaUYJwZyxO441ggHQIolrfJ5FpS+UvFhc6UHNKt8wYOsoG6vj9jSalQ6YygK6u0e05rHRBkpcdU+YG6jEUzfArQfV3iGatSOnUZeh6becA==',key_name='tempest-keypair-382930470',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='526ce0f27cc343a5ac86331ee21076ec',ramdisk_id='',reservation_id='r-i95b6tf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1273279077',owner_user_name='tempest-ServerActionsV293TestJSON-1273279077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:23:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b436a6349354f97a81ea3977aec28a5',uuid=552ba43b-6f39-4a9d-a93e-bb2831324d01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converting VIF {"id": "3bf19206-8843-4662-a147-edec46431a9b", "address": "fa:16:3e:7a:3c:b5", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf19206-88", "ovs_interfaceid": "3bf19206-8843-4662-a147-edec46431a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_vif [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bf19206-88, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:24:56 user nova-compute[70709]:   <uuid>779ac3df-ee2f-49a2-bb03-1a162eed34b0</uuid>
Jul 28 00:24:56 user nova-compute[70709]:   <name>instance-0000001a</name>
Jul 28 00:24:56 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:24:56 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:24:56 user nova-compute[70709]:   <metadata>
Jul 28 00:24:56 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:24:56 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:24:56 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeTestJSON-server-351485996</nova:name>
Jul 28 00:24:56 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:24:56</nova:creationTime>
Jul 28 00:24:56 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:24:56 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:24:56 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:24:56 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:24:56 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:24:56 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:24:56 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:24:56 user nova-compute[70709]:       <nova:owner>
Jul 28 00:24:56 user nova-compute[70709]:         <nova:user uuid="9c3a7c37bbe542008221fd2bcaf18f5c">tempest-AttachVolumeTestJSON-693253624-project-member</nova:user>
Jul 28 00:24:56 user nova-compute[70709]:         <nova:project uuid="7063760e8f3340f88a0505a3cdcdbf7c">tempest-AttachVolumeTestJSON-693253624</nova:project>
Jul 28 00:24:56 user nova-compute[70709]:       </nova:owner>
Jul 28 00:24:56 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:24:56 user nova-compute[70709]:       <nova:ports>
Jul 28 00:24:56 user nova-compute[70709]:         <nova:port uuid="ef4e9d67-7edd-45d8-93a2-6386992bbe38">
Jul 28 00:24:56 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 28 00:24:56 user nova-compute[70709]:         </nova:port>
Jul 28 00:24:56 user nova-compute[70709]:       </nova:ports>
Jul 28 00:24:56 user nova-compute[70709]:     </nova:instance>
Jul 28 00:24:56 user nova-compute[70709]:   </metadata>
Jul 28 00:24:56 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:24:56 user nova-compute[70709]:     <system>
Jul 28 00:24:56 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:24:56 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:24:56 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:24:56 user nova-compute[70709]:       <entry name="serial">779ac3df-ee2f-49a2-bb03-1a162eed34b0</entry>
Jul 28 00:24:56 user nova-compute[70709]:       <entry name="uuid">779ac3df-ee2f-49a2-bb03-1a162eed34b0</entry>
Jul 28 00:24:56 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:24:56 user nova-compute[70709]:     </system>
Jul 28 00:24:56 user nova-compute[70709]:   </sysinfo>
Jul 28 00:24:56 user nova-compute[70709]:   <os>
Jul 28 00:24:56 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:24:56 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:24:56 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:24:56 user nova-compute[70709]:   </os>
Jul 28 00:24:56 user nova-compute[70709]:   <features>
Jul 28 00:24:56 user nova-compute[70709]:     <acpi/>
Jul 28 00:24:56 user nova-compute[70709]:     <apic/>
Jul 28 00:24:56 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:24:56 user nova-compute[70709]:   </features>
Jul 28 00:24:56 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:24:56 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:24:56 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:24:56 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:24:56 user nova-compute[70709]:   </clock>
Jul 28 00:24:56 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:24:56 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:24:56 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:24:56 user nova-compute[70709]:   </cpu>
Jul 28 00:24:56 user nova-compute[70709]:   <devices>
Jul 28 00:24:56 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:24:56 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:24:56 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk"/>
Jul 28 00:24:56 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:24:56 user nova-compute[70709]:     </disk>
Jul 28 00:24:56 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:24:56 user nova-compute[70709]:       <mac address="fa:16:3e:79:18:f5"/>
Jul 28 00:24:56 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:24:56 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:24:56 user nova-compute[70709]:       <target dev="tapef4e9d67-7e"/>
Jul 28 00:24:56 user nova-compute[70709]:     </interface>
Jul 28 00:24:56 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:24:56 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/console.log" append="off"/>
Jul 28 00:24:56 user nova-compute[70709]:     </serial>
Jul 28 00:24:56 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:24:56 user nova-compute[70709]:     <video>
Jul 28 00:24:56 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:24:56 user nova-compute[70709]:     </video>
Jul 28 00:24:56 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:24:56 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:24:56 user nova-compute[70709]:     </rng>
Jul 28 00:24:56 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:24:56 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:24:56 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:24:56 user nova-compute[70709]:     </memballoon>
Jul 28 00:24:56 user nova-compute[70709]:   </devices>
Jul 28 00:24:56 user nova-compute[70709]: </domain>
Jul 28 00:24:56 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-351485996',display_name='tempest-AttachVolumeTestJSON-server-351485996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-351485996',id=26,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzSfZ6wRq06WNCWcdZJMRzozsDKoM7q2zH2vBqFVLmht1oKEN3dxAmPdwsv2p4K7T3eoGwbcDsFmpO0an/9/9yasb08wlPOPQcSvszJ4OZ+bwpId66smPFlv3jbuIsJEA==',key_name='tempest-keypair-1369163009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-3ydntjp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=779ac3df-ee2f-49a2-bb03-1a162eed34b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "address": "fa:16:3e:79:18:f5", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e9d67-7e", "ovs_interfaceid": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "address": "fa:16:3e:79:18:f5", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e9d67-7e", "ovs_interfaceid": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:18:f5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e9d67-7edd-45d8-93a2-6386992bbe38,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e9d67-7e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_vif [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:18:f5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e9d67-7edd-45d8-93a2-6386992bbe38,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e9d67-7e') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:24:56 user nova-compute[70709]: INFO os_vif [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bf19206-8843-4662-a147-edec46431a9b,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf19206-88')
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef4e9d67-7e, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef4e9d67-7e, col_values=(('external_ids', {'iface-id': 'ef4e9d67-7edd-45d8-93a2-6386992bbe38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:18:f5', 'vm-uuid': '779ac3df-ee2f-49a2-bb03-1a162eed34b0'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTJaFlYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:24:56 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:56 user nova-compute[70709]: INFO os_vif [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:18:f5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e9d67-7edd-45d8-93a2-6386992bbe38,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e9d67-7e')
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e85e31b-3448-4c25-86f9-e201149de57d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:24:56 user nova-compute[70709]: No targets found.
Jul 28 00:24:56 user nova-compute[70709]: iSNS:
Jul 28 00:24:56 user nova-compute[70709]: No targets found.
Jul 28 00:24:56 user nova-compute[70709]: STATIC:
Jul 28 00:24:56 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd
Jul 28 00:24:56 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:24:56 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:24:56 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860
Jul 28 00:24:56 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:24:56 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:24:56 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:24:56 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:24:56 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:24:56 user nova-compute[70709]: FIRMWARE:
Jul 28 00:24:56 user nova-compute[70709]: No targets found.
Jul 28 00:24:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:24:56 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:24:56 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b8a498-b4fe-4b14-b4e2-7cf47430e046]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No VIF found with MAC fa:16:3e:79:18:f5, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b361a3fe-47a5-43bc-badd-ddf3d81841b8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:24:56 user nova-compute[70709]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:24:56 user nova-compute[70709]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:24:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:24:56 user nova-compute[70709]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 (non-flash)
Jul 28 00:24:56 user nova-compute[70709]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:24:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b885844c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860'): ({'sdd'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Removing single pathed devices sdd {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0048a6a6-b352-44f1-a864-7f5b4648f022]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3f63ef-1723-4977-8bbc-474ff178a614]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Flushing IO for device /dev/sdd {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:24:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3abe7b3-e150-4600-a4bb-0b2a3a53a933]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.155s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b425467-1971-49c7-b8be-20c8b216582a]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15613a8-5f1c-4212-a3f2-a2ee4fd71ebe]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2242733-9215-4f36-9367-14a36e8740a1]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260]
Jul 28 00:24:57 user nova-compute[70709]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860, portal: 172.16.0.220,3260] successful.
Jul 28 00:24:57 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:24:57 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Snapshot image upload complete
Jul 28 00:24:57 user nova-compute[70709]: INFO nova.compute.manager [None req-8c714459-252f-4dc7-80de-9d0b23a63361 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Took 6.41 seconds to snapshot the instance on the hypervisor.
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57830a9a-041e-4dc0-b2e7-ae09961e9860 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[176b40ce-95bd-4cff-a332-0a3efcbe1519]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.526s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] <== disconnect_volume: return (529ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:24:57 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Deleting instance files /opt/stack/data/nova/instances/552ba43b-6f39-4a9d-a93e-bb2831324d01_del
Jul 28 00:24:57 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Deletion of /opt/stack/data/nova/instances/552ba43b-6f39-4a9d-a93e-bb2831324d01_del complete
Jul 28 00:24:57 user nova-compute[70709]: INFO nova.compute.manager [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Took 1.49 seconds to destroy the instance on the hypervisor.
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG nova.network.neutron [req-85b95f45-5ad0-46bb-bf66-ec27bdb460a5 req-ba2dd0d2-3e8c-42bc-a9c9-b7d70e4be240 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Updated VIF entry in instance network info cache for port ef4e9d67-7edd-45d8-93a2-6386992bbe38. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG nova.network.neutron [req-85b95f45-5ad0-46bb-bf66-ec27bdb460a5 req-ba2dd0d2-3e8c-42bc-a9c9-b7d70e4be240 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Updating instance_info_cache with network_info: [{"id": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "address": "fa:16:3e:79:18:f5", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e9d67-7e", "ovs_interfaceid": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-85b95f45-5ad0-46bb-bf66-ec27bdb460a5 req-ba2dd0d2-3e8c-42bc-a9c9-b7d70e4be240 service nova] Releasing lock "refresh_cache-779ac3df-ee2f-49a2-bb03-1a162eed34b0" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:24:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:58 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:24:58 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Took 1.05 seconds to deallocate network for instance.
Jul 28 00:24:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-41320cf2-4f4c-43c6-a28b-f1666d3afab4 req-41fb6186-411b-4375-a40c-aa1ffd689aa7 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-vif-deleted-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-c6d3dd7a-e8f4-4ab2-b16f-5a4c5e0f4bf4 req-fe346aed-5cc8-4bfe-8023-91d5ea45a739 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:24:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c6d3dd7a-e8f4-4ab2-b16f-5a4c5e0f4bf4 req-fe346aed-5cc8-4bfe-8023-91d5ea45a739 service nova] Acquiring lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c6d3dd7a-e8f4-4ab2-b16f-5a4c5e0f4bf4 req-fe346aed-5cc8-4bfe-8023-91d5ea45a739 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c6d3dd7a-e8f4-4ab2-b16f-5a4c5e0f4bf4 req-fe346aed-5cc8-4bfe-8023-91d5ea45a739 service nova] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-c6d3dd7a-e8f4-4ab2-b16f-5a4c5e0f4bf4 req-fe346aed-5cc8-4bfe-8023-91d5ea45a739 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] No waiting events found dispatching network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:24:58 user nova-compute[70709]: WARNING nova.compute.manager [req-c6d3dd7a-e8f4-4ab2-b16f-5a4c5e0f4bf4 req-fe346aed-5cc8-4bfe-8023-91d5ea45a739 service nova] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Received unexpected event network-vif-plugged-3bf19206-8843-4662-a147-edec46431a9b for instance with vm_state active and task_state deleting.
Jul 28 00:24:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "5fbef78b-fc10-46c8-8762-5471ca191316" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:24:59 user nova-compute[70709]: INFO nova.compute.claims [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Claim successful on node user
Jul 28 00:24:59 user nova-compute[70709]: INFO nova.compute.manager [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Took 1.12 seconds to detach 1 volumes for instance.
Jul 28 00:24:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Deleting volume: 57830a9a-041e-4dc0-b2e7-ae09961e9860 {{(pid=70709) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:24:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.265s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:25:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:25:00 user nova-compute[70709]: INFO nova.compute.manager [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Terminating instance
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.policy [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8557f7232a94f76982b8840c534a6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05b559855734f9e9b221ec954881ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:25:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Creating image(s)
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "/opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "/opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.152s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-6dea3050-2cf3-487c-901d-993a6f2206bd req-3a1402a3-3f73-4d11-8cbb-c46862ad7d78 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-vif-unplugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6dea3050-2cf3-487c-901d-993a6f2206bd req-3a1402a3-3f73-4d11-8cbb-c46862ad7d78 service nova] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6dea3050-2cf3-487c-901d-993a6f2206bd req-3a1402a3-3f73-4d11-8cbb-c46862ad7d78 service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6dea3050-2cf3-487c-901d-993a6f2206bd req-3a1402a3-3f73-4d11-8cbb-c46862ad7d78 service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-6dea3050-2cf3-487c-901d-993a6f2206bd req-3a1402a3-3f73-4d11-8cbb-c46862ad7d78 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] No waiting events found dispatching network-vif-unplugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-6dea3050-2cf3-487c-901d-993a6f2206bd req-3a1402a3-3f73-4d11-8cbb-c46862ad7d78 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-vif-unplugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.171s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Received event network-vif-plugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] No waiting events found dispatching network-vif-plugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:00 user nova-compute[70709]: WARNING nova.compute.manager [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Received unexpected event network-vif-plugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 for instance with vm_state building and task_state spawning.
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Received event network-vif-plugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] No waiting events found dispatching network-vif-plugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:00 user nova-compute[70709]: WARNING nova.compute.manager [req-f12fffca-8736-4deb-b5a5-520202b5de23 req-27600953-23b6-4361-8cd4-af6c44cdd75a service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Received unexpected event network-vif-plugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 for instance with vm_state building and task_state spawning.
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.773s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk 1073741824" returned: 0 in 0.085s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:00 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Deleted allocations for instance 552ba43b-6f39-4a9d-a93e-bb2831324d01
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503900.917927, 779ac3df-ee2f-49a2-bb03-1a162eed34b0 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:25:00 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] VM Resumed (Lifecycle Event)
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.169s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:25:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:01 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Instance spawned successfully.
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bc1ccafc-631d-41d6-807c-ab61c990d5fa tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "552ba43b-6f39-4a9d-a93e-bb2831324d01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.125s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:25:01 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Instance destroyed successfully.
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.objects.instance [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'resources' on Instance uuid 30ac2ae7-04f8-407e-8aee-1c515b61d564 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-581496249',display_name='tempest-TestMinimumBasicScenario-server-581496249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-581496249',id=17,image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGInO6F61l2DSAI2ovZyVDChqOqFo0h93AcA8cVc5MY/V3W3srH7250vULELir/NqHmMvUKxg5zkRriaDK8U+Au7OrnO7NCyYUZaahlOg0/rF5B85hTXPJCYAnIp9xleg==',key_name='tempest-TestMinimumBasicScenario-1965300536',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:19:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1de9e1809a584c68905d4c0f42302f8c',ramdisk_id='',reservation_id='r-apa0ef0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa772b26-5a84-447b-b1b6-f26fd0dad403',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1435468286',owner_user_name='tempest-TestMinimumBasicScenario-1435468286-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:22:17Z,user_data=None,user_id='9ed7d89a57234f37b4c578669bce4cdb',uuid=30ac2ae7-04f8-407e-8aee-1c515b61d564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converting VIF {"id": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "address": "fa:16:3e:6d:4b:f5", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65acb4df-b4", "ovs_interfaceid": "65acb4df-b4f6-4c60-ae40-7c65e73fc335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG os_vif [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:25:01 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503900.91821, 779ac3df-ee2f-49a2-bb03-1a162eed34b0 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:25:01 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] VM Started (Lifecycle Event)
Jul 28 00:25:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65acb4df-b4, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Cannot resize image /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'migration_context' on Instance uuid 5fbef78b-fc10-46c8-8762-5471ca191316 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:01 user nova-compute[70709]: INFO os_vif [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:4b:f5,bridge_name='br-int',has_traffic_filtering=True,id=65acb4df-b4f6-4c60-ae40-7c65e73fc335,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65acb4df-b4')
Jul 28 00:25:01 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Deleting instance files /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564_del
Jul 28 00:25:01 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Deletion of /opt/stack/data/nova/instances/30ac2ae7-04f8-407e-8aee-1c515b61d564_del complete
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Successfully created port: 898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:25:01 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Ensure instance console log exists: /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:01 user nova-compute[70709]: INFO nova.compute.manager [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Took 7.36 seconds to spawn the instance on the hypervisor.
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:01 user nova-compute[70709]: INFO nova.compute.manager [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Took 1.40 seconds to destroy the instance on the hypervisor.
Jul 28 00:25:01 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:25:01 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:25:01 user nova-compute[70709]: INFO nova.compute.manager [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Took 8.40 seconds to build instance.
Jul 28 00:25:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-5ca6a170-45f4-4878-9c4b-3222812f135f tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.518s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Successfully updated port: 898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "refresh_cache-5fbef78b-fc10-46c8-8762-5471ca191316" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquired lock "refresh_cache-5fbef78b-fc10-46c8-8762-5471ca191316" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-d81807e8-05ac-4cf9-82aa-efed2f2c7e7b req-a55ca4a3-905e-4889-8445-9b4e9956dd4a service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Received event network-changed-898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-d81807e8-05ac-4cf9-82aa-efed2f2c7e7b req-a55ca4a3-905e-4889-8445-9b4e9956dd4a service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Refreshing instance network info cache due to event network-changed-898f0691-1e6e-4a2e-a165-5a9f10387dda. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d81807e8-05ac-4cf9-82aa-efed2f2c7e7b req-a55ca4a3-905e-4889-8445-9b4e9956dd4a service nova] Acquiring lock "refresh_cache-5fbef78b-fc10-46c8-8762-5471ca191316" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-adbbad5d-0297-4766-92d2-aa7a4bf3adfd req-b6d2d3c6-575d-40f0-83bd-226d490a39aa service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-adbbad5d-0297-4766-92d2-aa7a4bf3adfd req-b6d2d3c6-575d-40f0-83bd-226d490a39aa service nova] Acquiring lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-adbbad5d-0297-4766-92d2-aa7a4bf3adfd req-b6d2d3c6-575d-40f0-83bd-226d490a39aa service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-adbbad5d-0297-4766-92d2-aa7a4bf3adfd req-b6d2d3c6-575d-40f0-83bd-226d490a39aa service nova] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-adbbad5d-0297-4766-92d2-aa7a4bf3adfd req-b6d2d3c6-575d-40f0-83bd-226d490a39aa service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] No waiting events found dispatching network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:02 user nova-compute[70709]: WARNING nova.compute.manager [req-adbbad5d-0297-4766-92d2-aa7a4bf3adfd req-b6d2d3c6-575d-40f0-83bd-226d490a39aa service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received unexpected event network-vif-plugged-65acb4df-b4f6-4c60-ae40-7c65e73fc335 for instance with vm_state active and task_state deleting.
Jul 28 00:25:02 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:02 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Took 1.19 seconds to deallocate network for instance.
Jul 28 00:25:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Updating instance_info_cache with network_info: [{"id": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "address": "fa:16:3e:f2:3a:3e", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898f0691-1e", "ovs_interfaceid": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Releasing lock "refresh_cache-5fbef78b-fc10-46c8-8762-5471ca191316" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Instance network_info: |[{"id": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "address": "fa:16:3e:f2:3a:3e", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898f0691-1e", "ovs_interfaceid": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d81807e8-05ac-4cf9-82aa-efed2f2c7e7b req-a55ca4a3-905e-4889-8445-9b4e9956dd4a service nova] Acquired lock "refresh_cache-5fbef78b-fc10-46c8-8762-5471ca191316" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-d81807e8-05ac-4cf9-82aa-efed2f2c7e7b req-a55ca4a3-905e-4889-8445-9b4e9956dd4a service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Refreshing network info cache for port 898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Start _get_guest_xml network_info=[{"id": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "address": "fa:16:3e:f2:3a:3e", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898f0691-1e", "ovs_interfaceid": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:25:03 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:25:03 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-498505944',display_name='tempest-AttachVolumeNegativeTest-server-498505944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-498505944',id=27,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxhkSYpSn1r9Xi8FNXPqyZLYmmPEztiVBGgT/LPbnfjdqVo7LNRS8PFFocNCvbJggKA0lP9Ao9RkDjUxu/8pgPTuB6QJJs/4IELpewuVoCqJFs+ndceGY4vJ7KD0hFbYQ==',key_name='tempest-keypair-1552314378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-zyjb6tpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=5fbef78b-fc10-46c8-8762-5471ca191316,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "address": "fa:16:3e:f2:3a:3e", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898f0691-1e", "ovs_interfaceid": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "address": "fa:16:3e:f2:3a:3e", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898f0691-1e", "ovs_interfaceid": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:3a:3e,bridge_name='br-int',has_traffic_filtering=True,id=898f0691-1e6e-4a2e-a165-5a9f10387dda,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898f0691-1e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fbef78b-fc10-46c8-8762-5471ca191316 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:25:03 user nova-compute[70709]:   <uuid>5fbef78b-fc10-46c8-8762-5471ca191316</uuid>
Jul 28 00:25:03 user nova-compute[70709]:   <name>instance-0000001b</name>
Jul 28 00:25:03 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:25:03 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:25:03 user nova-compute[70709]:   <metadata>
Jul 28 00:25:03 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:25:03 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:25:03 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeNegativeTest-server-498505944</nova:name>
Jul 28 00:25:03 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:25:03</nova:creationTime>
Jul 28 00:25:03 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:25:03 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:25:03 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:25:03 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:25:03 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:25:03 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:25:03 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:25:03 user nova-compute[70709]:       <nova:owner>
Jul 28 00:25:03 user nova-compute[70709]:         <nova:user uuid="d8557f7232a94f76982b8840c534a6d4">tempest-AttachVolumeNegativeTest-337281402-project-member</nova:user>
Jul 28 00:25:03 user nova-compute[70709]:         <nova:project uuid="e05b559855734f9e9b221ec954881ccd">tempest-AttachVolumeNegativeTest-337281402</nova:project>
Jul 28 00:25:03 user nova-compute[70709]:       </nova:owner>
Jul 28 00:25:03 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:25:03 user nova-compute[70709]:       <nova:ports>
Jul 28 00:25:03 user nova-compute[70709]:         <nova:port uuid="898f0691-1e6e-4a2e-a165-5a9f10387dda">
Jul 28 00:25:03 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 28 00:25:03 user nova-compute[70709]:         </nova:port>
Jul 28 00:25:03 user nova-compute[70709]:       </nova:ports>
Jul 28 00:25:03 user nova-compute[70709]:     </nova:instance>
Jul 28 00:25:03 user nova-compute[70709]:   </metadata>
Jul 28 00:25:03 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:25:03 user nova-compute[70709]:     <system>
Jul 28 00:25:03 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:25:03 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:25:03 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:25:03 user nova-compute[70709]:       <entry name="serial">5fbef78b-fc10-46c8-8762-5471ca191316</entry>
Jul 28 00:25:03 user nova-compute[70709]:       <entry name="uuid">5fbef78b-fc10-46c8-8762-5471ca191316</entry>
Jul 28 00:25:03 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:25:03 user nova-compute[70709]:     </system>
Jul 28 00:25:03 user nova-compute[70709]:   </sysinfo>
Jul 28 00:25:03 user nova-compute[70709]:   <os>
Jul 28 00:25:03 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:25:03 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:25:03 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:25:03 user nova-compute[70709]:   </os>
Jul 28 00:25:03 user nova-compute[70709]:   <features>
Jul 28 00:25:03 user nova-compute[70709]:     <acpi/>
Jul 28 00:25:03 user nova-compute[70709]:     <apic/>
Jul 28 00:25:03 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:25:03 user nova-compute[70709]:   </features>
Jul 28 00:25:03 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:25:03 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:25:03 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:25:03 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:25:03 user nova-compute[70709]:   </clock>
Jul 28 00:25:03 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:25:03 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:25:03 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:25:03 user nova-compute[70709]:   </cpu>
Jul 28 00:25:03 user nova-compute[70709]:   <devices>
Jul 28 00:25:03 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:25:03 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:25:03 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk"/>
Jul 28 00:25:03 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:25:03 user nova-compute[70709]:     </disk>
Jul 28 00:25:03 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:25:03 user nova-compute[70709]:       <mac address="fa:16:3e:f2:3a:3e"/>
Jul 28 00:25:03 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:25:03 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:25:03 user nova-compute[70709]:       <target dev="tap898f0691-1e"/>
Jul 28 00:25:03 user nova-compute[70709]:     </interface>
Jul 28 00:25:03 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:25:03 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/console.log" append="off"/>
Jul 28 00:25:03 user nova-compute[70709]:     </serial>
Jul 28 00:25:03 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:25:03 user nova-compute[70709]:     <video>
Jul 28 00:25:03 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:25:03 user nova-compute[70709]:     </video>
Jul 28 00:25:03 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:25:03 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:25:03 user nova-compute[70709]:     </rng>
Jul 28 00:25:03 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:25:03 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:25:03 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:25:03 user nova-compute[70709]:     </memballoon>
Jul 28 00:25:03 user nova-compute[70709]:   </devices>
Jul 28 00:25:03 user nova-compute[70709]: </domain>
Jul 28 00:25:03 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-498505944',display_name='tempest-AttachVolumeNegativeTest-server-498505944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-498505944',id=27,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxhkSYpSn1r9Xi8FNXPqyZLYmmPEztiVBGgT/LPbnfjdqVo7LNRS8PFFocNCvbJggKA0lP9Ao9RkDjUxu/8pgPTuB6QJJs/4IELpewuVoCqJFs+ndceGY4vJ7KD0hFbYQ==',key_name='tempest-keypair-1552314378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-zyjb6tpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=5fbef78b-fc10-46c8-8762-5471ca191316,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "address": "fa:16:3e:f2:3a:3e", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898f0691-1e", "ovs_interfaceid": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "address": "fa:16:3e:f2:3a:3e", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898f0691-1e", "ovs_interfaceid": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:3a:3e,bridge_name='br-int',has_traffic_filtering=True,id=898f0691-1e6e-4a2e-a165-5a9f10387dda,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898f0691-1e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG os_vif [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:3a:3e,bridge_name='br-int',has_traffic_filtering=True,id=898f0691-1e6e-4a2e-a165-5a9f10387dda,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898f0691-1e') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap898f0691-1e, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap898f0691-1e, col_values=(('external_ids', {'iface-id': '898f0691-1e6e-4a2e-a165-5a9f10387dda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:3a:3e', 'vm-uuid': '5fbef78b-fc10-46c8-8762-5471ca191316'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:03 user nova-compute[70709]: INFO os_vif [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:3a:3e,bridge_name='br-int',has_traffic_filtering=True,id=898f0691-1e6e-4a2e-a165-5a9f10387dda,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898f0691-1e')
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No VIF found with MAC fa:16:3e:f2:3a:3e, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:03 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Deleted allocations for instance 30ac2ae7-04f8-407e-8aee-1c515b61d564
Jul 28 00:25:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-add761f3-7b2c-456b-9169-8a43ead26868 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "30ac2ae7-04f8-407e-8aee-1c515b61d564" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.422s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-d81807e8-05ac-4cf9-82aa-efed2f2c7e7b req-a55ca4a3-905e-4889-8445-9b4e9956dd4a service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Updated VIF entry in instance network info cache for port 898f0691-1e6e-4a2e-a165-5a9f10387dda. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-d81807e8-05ac-4cf9-82aa-efed2f2c7e7b req-a55ca4a3-905e-4889-8445-9b4e9956dd4a service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Updating instance_info_cache with network_info: [{"id": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "address": "fa:16:3e:f2:3a:3e", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898f0691-1e", "ovs_interfaceid": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d81807e8-05ac-4cf9-82aa-efed2f2c7e7b req-a55ca4a3-905e-4889-8445-9b4e9956dd4a service nova] Releasing lock "refresh_cache-5fbef78b-fc10-46c8-8762-5471ca191316" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:25:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-2572608e-8e24-4699-9f3a-d14bfc71ebce req-efc88b1c-ae8c-43ca-8bd5-67ce1782f1e5 service nova] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Received event network-vif-deleted-65acb4df-b4f6-4c60-ae40-7c65e73fc335 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-bccf8337-131e-413f-a1ee-e5e61ed982e1 req-e125ca4f-5ebf-43c8-8d2a-1d474270defe service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Received event network-vif-plugged-898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bccf8337-131e-413f-a1ee-e5e61ed982e1 req-e125ca4f-5ebf-43c8-8d2a-1d474270defe service nova] Acquiring lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bccf8337-131e-413f-a1ee-e5e61ed982e1 req-e125ca4f-5ebf-43c8-8d2a-1d474270defe service nova] Lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bccf8337-131e-413f-a1ee-e5e61ed982e1 req-e125ca4f-5ebf-43c8-8d2a-1d474270defe service nova] Lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-bccf8337-131e-413f-a1ee-e5e61ed982e1 req-e125ca4f-5ebf-43c8-8d2a-1d474270defe service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] No waiting events found dispatching network-vif-plugged-898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:05 user nova-compute[70709]: WARNING nova.compute.manager [req-bccf8337-131e-413f-a1ee-e5e61ed982e1 req-e125ca4f-5ebf-43c8-8d2a-1d474270defe service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Received unexpected event network-vif-plugged-898f0691-1e6e-4a2e-a165-5a9f10387dda for instance with vm_state building and task_state spawning.
Jul 28 00:25:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:06 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503906.9798002, 5fbef78b-fc10-46c8-8762-5471ca191316 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:25:06 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] VM Resumed (Lifecycle Event)
Jul 28 00:25:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:25:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:25:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Instance spawned successfully.
Jul 28 00:25:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:07 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503906.9805408, 5fbef78b-fc10-46c8-8762-5471ca191316 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:25:07 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] VM Started (Lifecycle Event)
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-c1ac43b8-58bf-4e47-b83d-1dae5ff19bc3 req-c65537a6-1556-40c0-973e-4dc3ade37226 service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Received event network-vif-plugged-898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c1ac43b8-58bf-4e47-b83d-1dae5ff19bc3 req-c65537a6-1556-40c0-973e-4dc3ade37226 service nova] Acquiring lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c1ac43b8-58bf-4e47-b83d-1dae5ff19bc3 req-c65537a6-1556-40c0-973e-4dc3ade37226 service nova] Lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c1ac43b8-58bf-4e47-b83d-1dae5ff19bc3 req-c65537a6-1556-40c0-973e-4dc3ade37226 service nova] Lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-c1ac43b8-58bf-4e47-b83d-1dae5ff19bc3 req-c65537a6-1556-40c0-973e-4dc3ade37226 service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] No waiting events found dispatching network-vif-plugged-898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:07 user nova-compute[70709]: WARNING nova.compute.manager [req-c1ac43b8-58bf-4e47-b83d-1dae5ff19bc3 req-c65537a6-1556-40c0-973e-4dc3ade37226 service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Received unexpected event network-vif-plugged-898f0691-1e6e-4a2e-a165-5a9f10387dda for instance with vm_state building and task_state spawning.
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:25:07 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:25:07 user nova-compute[70709]: INFO nova.compute.manager [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Took 6.86 seconds to spawn the instance on the hypervisor.
Jul 28 00:25:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:07 user nova-compute[70709]: INFO nova.compute.manager [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Took 7.84 seconds to build instance.
Jul 28 00:25:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9308ca0a-e313-426a-98b2-c2740d9e2097 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.943s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:11 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503896.6881585, 552ba43b-6f39-4a9d-a93e-bb2831324d01 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:25:11 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] VM Stopped (Lifecycle Event)
Jul 28 00:25:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-96d952b9-a353-41e9-886f-49bbbe9d266d None None] [instance: 552ba43b-6f39-4a9d-a93e-bb2831324d01] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:25:14 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:14 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503900.9729962, 30ac2ae7-04f8-407e-8aee-1c515b61d564 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:25:16 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] VM Stopped (Lifecycle Event)
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e82ff290-4078-40fb-84a8-be567dae2e73 None None] [instance: 30ac2ae7-04f8-407e-8aee-1c515b61d564] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:25:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:18 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:25:18 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7378MB free_disk=25.266433715820312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance c6297718-d595-4657-aa32-aa75bffdf955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b451d103-db00-4cea-86ed-d23cab6120f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 44753afd-489f-48fa-ae42-0abaf29c2306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 773cf3d1-e98d-4002-bb1f-a3b33a36edac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 5fbef78b-fc10-46c8-8762-5471ca191316 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 00:25:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 00:25:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:25:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 00:25:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-3857937d-53af-4ded-a113-20a222d13178 req-cfe42f86-2363-40ec-8182-1f287555e4ee service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-changed-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-3857937d-53af-4ded-a113-20a222d13178 req-cfe42f86-2363-40ec-8182-1f287555e4ee service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Refreshing instance network info cache due to event network-changed-ee9a657a-7c7d-4849-8394-9438487032f9. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:25:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3857937d-53af-4ded-a113-20a222d13178 req-cfe42f86-2363-40ec-8182-1f287555e4ee service nova] Acquiring lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3857937d-53af-4ded-a113-20a222d13178 req-cfe42f86-2363-40ec-8182-1f287555e4ee service nova] Acquired lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:21 user nova-compute[70709]: DEBUG nova.network.neutron [req-3857937d-53af-4ded-a113-20a222d13178 req-cfe42f86-2363-40ec-8182-1f287555e4ee service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Refreshing network info cache for port ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:25:21 user nova-compute[70709]: DEBUG nova.network.neutron [req-3857937d-53af-4ded-a113-20a222d13178 req-cfe42f86-2363-40ec-8182-1f287555e4ee service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updated VIF entry in instance network info cache for port ee9a657a-7c7d-4849-8394-9438487032f9. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:25:21 user nova-compute[70709]: DEBUG nova.network.neutron [req-3857937d-53af-4ded-a113-20a222d13178 req-cfe42f86-2363-40ec-8182-1f287555e4ee service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updating instance_info_cache with network_info: [{"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3857937d-53af-4ded-a113-20a222d13178 req-cfe42f86-2363-40ec-8182-1f287555e4ee service nova] Releasing lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:25:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:22 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:22 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:25:22 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Stashing vm_state: active {{(pid=70709) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 28 00:25:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:22 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.objects.instance [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'pci_requests' on Instance uuid b451d103-db00-4cea-86ed-d23cab6120f5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:25:23 user nova-compute[70709]: INFO nova.compute.claims [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Claim successful on node user
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.objects.instance [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'resources' on Instance uuid b451d103-db00-4cea-86ed-d23cab6120f5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.objects.instance [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'pci_devices' on Instance uuid b451d103-db00-4cea-86ed-d23cab6120f5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:23 user nova-compute[70709]: INFO nova.compute.resource_tracker [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updating resource usage from migration 846dd87e-b530-4986-9a01-f330488137e5
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-fbd99114-c460-4320-861c-5da1fa2be28c req-f4b38594-c747-4933-9ac5-1b7ecf368936 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-changed-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-fbd99114-c460-4320-861c-5da1fa2be28c req-f4b38594-c747-4933-9ac5-1b7ecf368936 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Refreshing instance network info cache due to event network-changed-23cdc0f2-530f-439d-b533-dea81f764fdf. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fbd99114-c460-4320-861c-5da1fa2be28c req-f4b38594-c747-4933-9ac5-1b7ecf368936 service nova] Acquiring lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fbd99114-c460-4320-861c-5da1fa2be28c req-f4b38594-c747-4933-9ac5-1b7ecf368936 service nova] Acquired lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.network.neutron [req-fbd99114-c460-4320-861c-5da1fa2be28c req-f4b38594-c747-4933-9ac5-1b7ecf368936 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Refreshing network info cache for port 23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.654s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:23 user nova-compute[70709]: INFO nova.compute.manager [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Migrating
Jul 28 00:25:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.network.neutron [req-fbd99114-c460-4320-861c-5da1fa2be28c req-f4b38594-c747-4933-9ac5-1b7ecf368936 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updated VIF entry in instance network info cache for port 23cdc0f2-530f-439d-b533-dea81f764fdf. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.network.neutron [req-fbd99114-c460-4320-861c-5da1fa2be28c req-f4b38594-c747-4933-9ac5-1b7ecf368936 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updating instance_info_cache with network_info: [{"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fbd99114-c460-4320-861c-5da1fa2be28c req-f4b38594-c747-4933-9ac5-1b7ecf368936 service nova] Releasing lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquired lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Updating instance_info_cache with network_info: [{"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:25:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:24 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updating instance_info_cache with network_info: [{"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Releasing lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:25:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Starting migrate_disk_and_power_off {{(pid=70709) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 28 00:25:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-vif-unplugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] No waiting events found dispatching network-vif-unplugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:25 user nova-compute[70709]: WARNING nova.compute.manager [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received unexpected event network-vif-unplugged-23cdc0f2-530f-439d-b533-dea81f764fdf for instance with vm_state active and task_state resize_migrating.
Jul 28 00:25:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] No waiting events found dispatching network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:25 user nova-compute[70709]: WARNING nova.compute.manager [req-8abf74b5-4ead-4fcb-b8e1-3ba22beb3c64 req-3a8fa776-b3e0-4832-afc0-d053f2fe6936 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received unexpected event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf for instance with vm_state active and task_state resize_migrating.
Jul 28 00:25:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Instance destroyed successfully.
Jul 28 00:25:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1501930603',display_name='tempest-ServerActionsTestOtherA-server-1501930603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1501930603',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-7hnta9w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:25:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b451d103-db00-4cea-86ed-d23cab6120f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1418448163-network", "vif_mac": "fa:16:3e:a1:ba:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1418448163-network", "vif_mac": "fa:16:3e:a1:ba:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_vif [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23cdc0f2-53, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:25:25 user nova-compute[70709]: INFO os_vif [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53')
Jul 28 00:25:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUCivjol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:25:25 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b98a0-4c9a-491d-84fa-64b6a3e13958]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:25:25 user nova-compute[70709]: No targets found.
Jul 28 00:25:25 user nova-compute[70709]: iSNS:
Jul 28 00:25:25 user nova-compute[70709]: No targets found.
Jul 28 00:25:25 user nova-compute[70709]: STATIC:
Jul 28 00:25:25 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd
Jul 28 00:25:25 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:25:25 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:25:25 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:25:25 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:25:25 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:25:25 user nova-compute[70709]: FIRMWARE:
Jul 28 00:25:25 user nova-compute[70709]: No targets found.
Jul 28 00:25:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:25:25 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:25:25 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe33417c-9bc4-4d14-a197-552155af0a47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a773e39-1cdb-459b-99a8-f2eb71857a9f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:25:25 user nova-compute[70709]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:25:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:25:25 user nova-compute[70709]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:25:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b885e17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd'): ({'sde'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Removing single pathed devices sde {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c14f4e-7914-4f8a-b2f5-2b4da2ef6824]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23d892f-d0e5-456b-881e-4d3921b84420]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flushing IO for device /dev/sde {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4880884e-5371-48ca-9d1b-a1b6bc25ccf5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ef19cf-b6ea-4bfc-ade3-4374b5a1fd14]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46713c3-d3f8-4391-bf64-afdd541bc272]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e647da9a-37bd-454a-bda9-b53dacf9f0d2]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260]
Jul 28 00:25:25 user nova-compute[70709]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260] successful.
Jul 28 00:25:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[30176414-41e9-43e6-b33a-04eb0441fa64]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== disconnect_volume: return (368ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:25:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:25:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:26 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Port 23cdc0f2-530f-439d-b533-dea81f764fdf binding to destination host user is already ACTIVE {{(pid=70709) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquired lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updating instance_info_cache with network_info: [{"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Releasing lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG os_brick.utils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f192df7-b1b1-4651-a71d-c5c354839735]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d596caa-b017-4617-91e0-b779e1c07ae6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0971ca23-a761-4a38-b489-c4f0e850fabf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d5c769-b7ac-44b9-89ac-61a630cb19dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:25:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:25:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:25:28 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:25:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c682d9-8655-4e71-be25-b06fb264eb48]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:25:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:25:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:25:28 user nova-compute[70709]: DEBUG os_brick.utils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:25:28 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:25:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Starting finish_migration {{(pid=70709) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Instance directory exists: not creating {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 28 00:25:35 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Creating image(s)
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Ensure instance console log exists: /opt/stack/data/nova/instances/b451d103-db00-4cea-86ed-d23cab6120f5/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Start _get_guest_xml network_info=[{"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1418448163-network", "vif_mac": "fa:16:3e:a1:ba:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'd01a7de1-c91f-4393-b21d-0a162e9c85a3', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUCivjol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b451d103-db00-4cea-86ed-d23cab6120f5', 'attached_at': '2023-07-28T00:25:35.000000', 'detached_at': '', 'volume_id': '99c4acdd-1e96-4dc5-9c0f-78668c233efd', 'serial': '99c4acdd-1e96-4dc5-9c0f-78668c233efd'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:25:35 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:25:35 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.objects.instance [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'vcpu_model' on Instance uuid b451d103-db00-4cea-86ed-d23cab6120f5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUCivjol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:25:35 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:25:35 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:25:35 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2af2ada-d2d6-4003-a2a0-185732cb4c51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:25:35 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d847823-9d38-432c-bbd7-ec1edbcf54fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd] added
Jul 28 00:25:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[31078938-1e71-411a-8d15-15b1fad48003]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d92873-054d-46b3-8485-cf400b029470]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUCivjol {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUCivjol" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9613de-3f75-4ea2-9b1b-666ccee625b9]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aUCivjol'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f6b948-5e63-42ee-b884-7a96f6367426]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bcde7d-27c8-4834-b956-5691a5e8fff2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:25:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:25:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15ba2e0-9abb-47ec-9cc6-056b89e34c03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260]
Jul 28 00:25:35 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260] successful.
Jul 28 00:25:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[930964fd-8afd-43ce-b537-f563f27ae149]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec580004-f48e-4ef2-beab-57faab95a876]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:25:35 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:25:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:25:35 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:25:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5fcbbe-7bfe-4ead-8376-5a13b41ae574]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:25:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUCivjol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26136313263333866', 'path': '/dev/sdc'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136313263333866', 'path': '/dev/sdc'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1501930603',display_name='tempest-ServerActionsTestOtherA-server-1501930603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1501930603',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-7hnta9w3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:25:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b451d103-db00-4cea-86ed-d23cab6120f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1418448163-network", "vif_mac": "fa:16:3e:a1:ba:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1418448163-network", "vif_mac": "fa:16:3e:a1:ba:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:25:36 user nova-compute[70709]:   <uuid>b451d103-db00-4cea-86ed-d23cab6120f5</uuid>
Jul 28 00:25:36 user nova-compute[70709]:   <name>instance-00000017</name>
Jul 28 00:25:36 user nova-compute[70709]:   <memory>2097152</memory>
Jul 28 00:25:36 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:25:36 user nova-compute[70709]:   <metadata>
Jul 28 00:25:36 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:25:36 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:25:36 user nova-compute[70709]:       <nova:name>tempest-ServerActionsTestOtherA-server-1501930603</nova:name>
Jul 28 00:25:36 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:25:35</nova:creationTime>
Jul 28 00:25:36 user nova-compute[70709]:       <nova:flavor name="m1.small">
Jul 28 00:25:36 user nova-compute[70709]:         <nova:memory>2048</nova:memory>
Jul 28 00:25:36 user nova-compute[70709]:         <nova:disk>20</nova:disk>
Jul 28 00:25:36 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:25:36 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:25:36 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:25:36 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:25:36 user nova-compute[70709]:       <nova:owner>
Jul 28 00:25:36 user nova-compute[70709]:         <nova:user uuid="384ba52cf0bd4f03ac0dfc73cc81b31d">tempest-ServerActionsTestOtherA-448184614-project-member</nova:user>
Jul 28 00:25:36 user nova-compute[70709]:         <nova:project uuid="92ce75e559c74038919f88f186e35a17">tempest-ServerActionsTestOtherA-448184614</nova:project>
Jul 28 00:25:36 user nova-compute[70709]:       </nova:owner>
Jul 28 00:25:36 user nova-compute[70709]:       <nova:ports>
Jul 28 00:25:36 user nova-compute[70709]:         <nova:port uuid="23cdc0f2-530f-439d-b533-dea81f764fdf">
Jul 28 00:25:36 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 28 00:25:36 user nova-compute[70709]:         </nova:port>
Jul 28 00:25:36 user nova-compute[70709]:       </nova:ports>
Jul 28 00:25:36 user nova-compute[70709]:     </nova:instance>
Jul 28 00:25:36 user nova-compute[70709]:   </metadata>
Jul 28 00:25:36 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:25:36 user nova-compute[70709]:     <system>
Jul 28 00:25:36 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:25:36 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:25:36 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:25:36 user nova-compute[70709]:       <entry name="serial">b451d103-db00-4cea-86ed-d23cab6120f5</entry>
Jul 28 00:25:36 user nova-compute[70709]:       <entry name="uuid">b451d103-db00-4cea-86ed-d23cab6120f5</entry>
Jul 28 00:25:36 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:25:36 user nova-compute[70709]:     </system>
Jul 28 00:25:36 user nova-compute[70709]:   </sysinfo>
Jul 28 00:25:36 user nova-compute[70709]:   <os>
Jul 28 00:25:36 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:25:36 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:25:36 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:25:36 user nova-compute[70709]:   </os>
Jul 28 00:25:36 user nova-compute[70709]:   <features>
Jul 28 00:25:36 user nova-compute[70709]:     <acpi/>
Jul 28 00:25:36 user nova-compute[70709]:     <apic/>
Jul 28 00:25:36 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:25:36 user nova-compute[70709]:   </features>
Jul 28 00:25:36 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:25:36 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:25:36 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:25:36 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:25:36 user nova-compute[70709]:   </clock>
Jul 28 00:25:36 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:25:36 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:25:36 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:25:36 user nova-compute[70709]:   </cpu>
Jul 28 00:25:36 user nova-compute[70709]:   <devices>
Jul 28 00:25:36 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:25:36 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:25:36 user nova-compute[70709]:       <source dev="/dev/sdc"/>
Jul 28 00:25:36 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:25:36 user nova-compute[70709]:       <serial>99c4acdd-1e96-4dc5-9c0f-78668c233efd</serial>
Jul 28 00:25:36 user nova-compute[70709]:     </disk>
Jul 28 00:25:36 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:25:36 user nova-compute[70709]:       <mac address="fa:16:3e:a1:ba:61"/>
Jul 28 00:25:36 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:25:36 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:25:36 user nova-compute[70709]:       <target dev="tap23cdc0f2-53"/>
Jul 28 00:25:36 user nova-compute[70709]:     </interface>
Jul 28 00:25:36 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:25:36 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/b451d103-db00-4cea-86ed-d23cab6120f5/console.log" append="off"/>
Jul 28 00:25:36 user nova-compute[70709]:     </serial>
Jul 28 00:25:36 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:25:36 user nova-compute[70709]:     <video>
Jul 28 00:25:36 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:25:36 user nova-compute[70709]:     </video>
Jul 28 00:25:36 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:25:36 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:25:36 user nova-compute[70709]:     </rng>
Jul 28 00:25:36 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:25:36 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:25:36 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:25:36 user nova-compute[70709]:     </memballoon>
Jul 28 00:25:36 user nova-compute[70709]:   </devices>
Jul 28 00:25:36 user nova-compute[70709]: </domain>
Jul 28 00:25:36 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1501930603',display_name='tempest-ServerActionsTestOtherA-server-1501930603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1501930603',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-7hnta9w3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:25:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b451d103-db00-4cea-86ed-d23cab6120f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1418448163-network", "vif_mac": "fa:16:3e:a1:ba:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1418448163-network", "vif_mac": "fa:16:3e:a1:ba:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG os_vif [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23cdc0f2-53, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23cdc0f2-53, col_values=(('external_ids', {'iface-id': '23cdc0f2-530f-439d-b533-dea81f764fdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:ba:61', 'vm-uuid': 'b451d103-db00-4cea-86ed-d23cab6120f5'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:36 user nova-compute[70709]: INFO os_vif [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53')
Jul 28 00:25:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:25:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] No VIF found with MAC fa:16:3e:a1:ba:61, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:25:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Acquiring lock "33394dd6-b87c-438d-a55c-4c530d308feb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "33394dd6-b87c-438d-a55c-4c530d308feb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:25:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:37 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:25:37 user nova-compute[70709]: INFO nova.compute.claims [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Claim successful on node user
Jul 28 00:25:38 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:38 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:25:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:25:38 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Creating image(s)
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Acquiring lock "/opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "/opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "/opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG nova.policy [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06adcab697af44a4a122dd90bd4df02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5313d36ce88544ae80e7b9ec6f026a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-36445882-fe3d-4f74-ba30-eceb0d5c7da9 req-870b78e3-6dac-4af2-8cfa-ea6b2bffc877 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-36445882-fe3d-4f74-ba30-eceb0d5c7da9 req-870b78e3-6dac-4af2-8cfa-ea6b2bffc877 service nova] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-36445882-fe3d-4f74-ba30-eceb0d5c7da9 req-870b78e3-6dac-4af2-8cfa-ea6b2bffc877 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-36445882-fe3d-4f74-ba30-eceb0d5c7da9 req-870b78e3-6dac-4af2-8cfa-ea6b2bffc877 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG nova.compute.manager [req-36445882-fe3d-4f74-ba30-eceb0d5c7da9 req-870b78e3-6dac-4af2-8cfa-ea6b2bffc877 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] No waiting events found dispatching network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:38 user nova-compute[70709]: WARNING nova.compute.manager [req-36445882-fe3d-4f74-ba30-eceb0d5c7da9 req-870b78e3-6dac-4af2-8cfa-ea6b2bffc877 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received unexpected event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf for instance with vm_state active and task_state resize_finish.
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.227s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.183s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk 1073741824" returned: 0 in 0.070s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.172s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Cannot resize image /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG nova.objects.instance [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lazy-loading 'migration_context' on Instance uuid 33394dd6-b87c-438d-a55c-4c530d308feb {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Ensure instance console log exists: /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:39 user nova-compute[70709]: DEBUG nova.network.neutron [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Successfully created port: 6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503925.3499238, b451d103-db00-4cea-86ed-d23cab6120f5 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:25:40 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] VM Stopped (Lifecycle Event)
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-0898eb32-0024-40cc-9869-4fc5464cdc06 None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.network.neutron [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Successfully updated port: 6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Acquiring lock "refresh_cache-33394dd6-b87c-438d-a55c-4c530d308feb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Acquired lock "refresh_cache-33394dd6-b87c-438d-a55c-4c530d308feb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.network.neutron [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.compute.manager [req-eeba02ea-7289-4cda-aa9f-e3ad7d1472ad req-7408b48e-f035-450e-bcc8-07a5df9aca9b service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Received event network-changed-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.compute.manager [req-eeba02ea-7289-4cda-aa9f-e3ad7d1472ad req-7408b48e-f035-450e-bcc8-07a5df9aca9b service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Refreshing instance network info cache due to event network-changed-6fefc47c-0c33-4de6-8b35-7fdf6b61f824. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-eeba02ea-7289-4cda-aa9f-e3ad7d1472ad req-7408b48e-f035-450e-bcc8-07a5df9aca9b service nova] Acquiring lock "refresh_cache-33394dd6-b87c-438d-a55c-4c530d308feb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.network.neutron [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.compute.manager [req-ce029930-1673-4f8a-9384-ec0f20df2de8 req-8c925925-be85-45af-97e9-24b3de5027a6 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ce029930-1673-4f8a-9384-ec0f20df2de8 req-8c925925-be85-45af-97e9-24b3de5027a6 service nova] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ce029930-1673-4f8a-9384-ec0f20df2de8 req-8c925925-be85-45af-97e9-24b3de5027a6 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ce029930-1673-4f8a-9384-ec0f20df2de8 req-8c925925-be85-45af-97e9-24b3de5027a6 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.compute.manager [req-ce029930-1673-4f8a-9384-ec0f20df2de8 req-8c925925-be85-45af-97e9-24b3de5027a6 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] No waiting events found dispatching network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:40 user nova-compute[70709]: WARNING nova.compute.manager [req-ce029930-1673-4f8a-9384-ec0f20df2de8 req-8c925925-be85-45af-97e9-24b3de5027a6 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received unexpected event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf for instance with vm_state active and task_state resize_finish.
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503940.6532629, b451d103-db00-4cea-86ed-d23cab6120f5 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:25:40 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] VM Resumed (Lifecycle Event)
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:25:40 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Instance running successfully.
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Failed to set time: agent not configured {{(pid=70709) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2656bbfa-f523-4f26-92ce-01259531cc12 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] finish_migration finished successfully. {{(pid=70709) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:25:40 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503940.6598928, b451d103-db00-4cea-86ed-d23cab6120f5 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:25:40 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] VM Started (Lifecycle Event)
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:25:40 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.network.neutron [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Updating instance_info_cache with network_info: [{"id": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "address": "fa:16:3e:75:a8:8c", "network": {"id": "4a34050d-91e7-4e28-bc8a-ef9857c9f6ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dfaa8247d31a480f99168e883a0b1888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fefc47c-0c", "ovs_interfaceid": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Releasing lock "refresh_cache-33394dd6-b87c-438d-a55c-4c530d308feb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Instance network_info: |[{"id": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "address": "fa:16:3e:75:a8:8c", "network": {"id": "4a34050d-91e7-4e28-bc8a-ef9857c9f6ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dfaa8247d31a480f99168e883a0b1888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fefc47c-0c", "ovs_interfaceid": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-eeba02ea-7289-4cda-aa9f-e3ad7d1472ad req-7408b48e-f035-450e-bcc8-07a5df9aca9b service nova] Acquired lock "refresh_cache-33394dd6-b87c-438d-a55c-4c530d308feb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.network.neutron [req-eeba02ea-7289-4cda-aa9f-e3ad7d1472ad req-7408b48e-f035-450e-bcc8-07a5df9aca9b service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Refreshing network info cache for port 6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Start _get_guest_xml network_info=[{"id": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "address": "fa:16:3e:75:a8:8c", "network": {"id": "4a34050d-91e7-4e28-bc8a-ef9857c9f6ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dfaa8247d31a480f99168e883a0b1888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fefc47c-0c", "ovs_interfaceid": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:25:40 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:25:40 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-600454763',display_name='tempest-VolumesNegativeTest-instance-600454763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-600454763',id=28,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5313d36ce88544ae80e7b9ec6f026a36',ramdisk_id='',reservation_id='r-0rjraqiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1368927597',owner_user_name='tempest-VolumesNegativeTest-1368927597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:25:38Z,user_data=None,user_id='06adcab697af44a4a122dd90bd4df02a',uuid=33394dd6-b87c-438d-a55c-4c530d308feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "address": "fa:16:3e:75:a8:8c", "network": {"id": "4a34050d-91e7-4e28-bc8a-ef9857c9f6ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dfaa8247d31a480f99168e883a0b1888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fefc47c-0c", "ovs_interfaceid": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:25:40 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Converting VIF {"id": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "address": "fa:16:3e:75:a8:8c", "network": {"id": "4a34050d-91e7-4e28-bc8a-ef9857c9f6ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dfaa8247d31a480f99168e883a0b1888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fefc47c-0c", "ovs_interfaceid": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a8:8c,bridge_name='br-int',has_traffic_filtering=True,id=6fefc47c-0c33-4de6-8b35-7fdf6b61f824,network=Network(4a34050d-91e7-4e28-bc8a-ef9857c9f6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fefc47c-0c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG nova.objects.instance [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lazy-loading 'pci_devices' on Instance uuid 33394dd6-b87c-438d-a55c-4c530d308feb {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:25:41 user nova-compute[70709]:   <uuid>33394dd6-b87c-438d-a55c-4c530d308feb</uuid>
Jul 28 00:25:41 user nova-compute[70709]:   <name>instance-0000001c</name>
Jul 28 00:25:41 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:25:41 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:25:41 user nova-compute[70709]:   <metadata>
Jul 28 00:25:41 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:25:41 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:25:41 user nova-compute[70709]:       <nova:name>tempest-VolumesNegativeTest-instance-600454763</nova:name>
Jul 28 00:25:41 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:25:40</nova:creationTime>
Jul 28 00:25:41 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:25:41 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:25:41 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:25:41 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:25:41 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:25:41 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:25:41 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:25:41 user nova-compute[70709]:       <nova:owner>
Jul 28 00:25:41 user nova-compute[70709]:         <nova:user uuid="06adcab697af44a4a122dd90bd4df02a">tempest-VolumesNegativeTest-1368927597-project-member</nova:user>
Jul 28 00:25:41 user nova-compute[70709]:         <nova:project uuid="5313d36ce88544ae80e7b9ec6f026a36">tempest-VolumesNegativeTest-1368927597</nova:project>
Jul 28 00:25:41 user nova-compute[70709]:       </nova:owner>
Jul 28 00:25:41 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:25:41 user nova-compute[70709]:       <nova:ports>
Jul 28 00:25:41 user nova-compute[70709]:         <nova:port uuid="6fefc47c-0c33-4de6-8b35-7fdf6b61f824">
Jul 28 00:25:41 user nova-compute[70709]:           <nova:ip type="fixed" address="192.168.233.198" ipVersion="4"/>
Jul 28 00:25:41 user nova-compute[70709]:         </nova:port>
Jul 28 00:25:41 user nova-compute[70709]:       </nova:ports>
Jul 28 00:25:41 user nova-compute[70709]:     </nova:instance>
Jul 28 00:25:41 user nova-compute[70709]:   </metadata>
Jul 28 00:25:41 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:25:41 user nova-compute[70709]:     <system>
Jul 28 00:25:41 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:25:41 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:25:41 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:25:41 user nova-compute[70709]:       <entry name="serial">33394dd6-b87c-438d-a55c-4c530d308feb</entry>
Jul 28 00:25:41 user nova-compute[70709]:       <entry name="uuid">33394dd6-b87c-438d-a55c-4c530d308feb</entry>
Jul 28 00:25:41 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:25:41 user nova-compute[70709]:     </system>
Jul 28 00:25:41 user nova-compute[70709]:   </sysinfo>
Jul 28 00:25:41 user nova-compute[70709]:   <os>
Jul 28 00:25:41 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:25:41 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:25:41 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:25:41 user nova-compute[70709]:   </os>
Jul 28 00:25:41 user nova-compute[70709]:   <features>
Jul 28 00:25:41 user nova-compute[70709]:     <acpi/>
Jul 28 00:25:41 user nova-compute[70709]:     <apic/>
Jul 28 00:25:41 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:25:41 user nova-compute[70709]:   </features>
Jul 28 00:25:41 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:25:41 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:25:41 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:25:41 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:25:41 user nova-compute[70709]:   </clock>
Jul 28 00:25:41 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:25:41 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:25:41 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:25:41 user nova-compute[70709]:   </cpu>
Jul 28 00:25:41 user nova-compute[70709]:   <devices>
Jul 28 00:25:41 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:25:41 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:25:41 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk"/>
Jul 28 00:25:41 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:25:41 user nova-compute[70709]:     </disk>
Jul 28 00:25:41 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:25:41 user nova-compute[70709]:       <mac address="fa:16:3e:75:a8:8c"/>
Jul 28 00:25:41 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:25:41 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:25:41 user nova-compute[70709]:       <target dev="tap6fefc47c-0c"/>
Jul 28 00:25:41 user nova-compute[70709]:     </interface>
Jul 28 00:25:41 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:25:41 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/console.log" append="off"/>
Jul 28 00:25:41 user nova-compute[70709]:     </serial>
Jul 28 00:25:41 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:25:41 user nova-compute[70709]:     <video>
Jul 28 00:25:41 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:25:41 user nova-compute[70709]:     </video>
Jul 28 00:25:41 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:25:41 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:25:41 user nova-compute[70709]:     </rng>
Jul 28 00:25:41 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:25:41 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:25:41 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:25:41 user nova-compute[70709]:     </memballoon>
Jul 28 00:25:41 user nova-compute[70709]:   </devices>
Jul 28 00:25:41 user nova-compute[70709]: </domain>
Jul 28 00:25:41 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-600454763',display_name='tempest-VolumesNegativeTest-instance-600454763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-600454763',id=28,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5313d36ce88544ae80e7b9ec6f026a36',ramdisk_id='',reservation_id='r-0rjraqiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1368927597',owner_user_name='tempest-VolumesNegativeTest-1368927597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:25:38Z,user_data=None,user_id='06adcab697af44a4a122dd90bd4df02a',uuid=33394dd6-b87c-438d-a55c-4c530d308feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "address": "fa:16:3e:75:a8:8c", "network": {"id": "4a34050d-91e7-4e28-bc8a-ef9857c9f6ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dfaa8247d31a480f99168e883a0b1888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fefc47c-0c", "ovs_interfaceid": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Converting VIF {"id": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "address": "fa:16:3e:75:a8:8c", "network": {"id": "4a34050d-91e7-4e28-bc8a-ef9857c9f6ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dfaa8247d31a480f99168e883a0b1888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fefc47c-0c", "ovs_interfaceid": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a8:8c,bridge_name='br-int',has_traffic_filtering=True,id=6fefc47c-0c33-4de6-8b35-7fdf6b61f824,network=Network(4a34050d-91e7-4e28-bc8a-ef9857c9f6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fefc47c-0c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG os_vif [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a8:8c,bridge_name='br-int',has_traffic_filtering=True,id=6fefc47c-0c33-4de6-8b35-7fdf6b61f824,network=Network(4a34050d-91e7-4e28-bc8a-ef9857c9f6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fefc47c-0c') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fefc47c-0c, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fefc47c-0c, col_values=(('external_ids', {'iface-id': '6fefc47c-0c33-4de6-8b35-7fdf6b61f824', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:a8:8c', 'vm-uuid': '33394dd6-b87c-438d-a55c-4c530d308feb'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:41 user nova-compute[70709]: INFO os_vif [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a8:8c,bridge_name='br-int',has_traffic_filtering=True,id=6fefc47c-0c33-4de6-8b35-7fdf6b61f824,network=Network(4a34050d-91e7-4e28-bc8a-ef9857c9f6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fefc47c-0c')
Jul 28 00:25:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] No VIF found with MAC fa:16:3e:75:a8:8c, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-eeba02ea-7289-4cda-aa9f-e3ad7d1472ad req-7408b48e-f035-450e-bcc8-07a5df9aca9b service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Updated VIF entry in instance network info cache for port 6fefc47c-0c33-4de6-8b35-7fdf6b61f824. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-eeba02ea-7289-4cda-aa9f-e3ad7d1472ad req-7408b48e-f035-450e-bcc8-07a5df9aca9b service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Updating instance_info_cache with network_info: [{"id": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "address": "fa:16:3e:75:a8:8c", "network": {"id": "4a34050d-91e7-4e28-bc8a-ef9857c9f6ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dfaa8247d31a480f99168e883a0b1888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fefc47c-0c", "ovs_interfaceid": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-eeba02ea-7289-4cda-aa9f-e3ad7d1472ad req-7408b48e-f035-450e-bcc8-07a5df9aca9b service nova] Releasing lock "refresh_cache-33394dd6-b87c-438d-a55c-4c530d308feb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:25:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-9309eb8a-8579-4e1f-bc3d-de8bc94fc80a req-b6aa4751-6a55-4ac6-a1e8-4f9d6277447c service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Received event network-vif-plugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9309eb8a-8579-4e1f-bc3d-de8bc94fc80a req-b6aa4751-6a55-4ac6-a1e8-4f9d6277447c service nova] Acquiring lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9309eb8a-8579-4e1f-bc3d-de8bc94fc80a req-b6aa4751-6a55-4ac6-a1e8-4f9d6277447c service nova] Lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9309eb8a-8579-4e1f-bc3d-de8bc94fc80a req-b6aa4751-6a55-4ac6-a1e8-4f9d6277447c service nova] Lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-9309eb8a-8579-4e1f-bc3d-de8bc94fc80a req-b6aa4751-6a55-4ac6-a1e8-4f9d6277447c service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] No waiting events found dispatching network-vif-plugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:42 user nova-compute[70709]: WARNING nova.compute.manager [req-9309eb8a-8579-4e1f-bc3d-de8bc94fc80a req-b6aa4751-6a55-4ac6-a1e8-4f9d6277447c service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Received unexpected event network-vif-plugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 for instance with vm_state building and task_state spawning.
Jul 28 00:25:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503944.8753617, 33394dd6-b87c-438d-a55c-4c530d308feb => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:25:44 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] VM Resumed (Lifecycle Event)
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:25:44 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Instance spawned successfully.
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-3d4ba6ab-f50e-45c5-a9a8-48fdebe533b2 req-26b54826-b287-4115-bf24-be7ef94fbeaa service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Received event network-vif-plugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3d4ba6ab-f50e-45c5-a9a8-48fdebe533b2 req-26b54826-b287-4115-bf24-be7ef94fbeaa service nova] Acquiring lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3d4ba6ab-f50e-45c5-a9a8-48fdebe533b2 req-26b54826-b287-4115-bf24-be7ef94fbeaa service nova] Lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3d4ba6ab-f50e-45c5-a9a8-48fdebe533b2 req-26b54826-b287-4115-bf24-be7ef94fbeaa service nova] Lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-3d4ba6ab-f50e-45c5-a9a8-48fdebe533b2 req-26b54826-b287-4115-bf24-be7ef94fbeaa service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] No waiting events found dispatching network-vif-plugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:44 user nova-compute[70709]: WARNING nova.compute.manager [req-3d4ba6ab-f50e-45c5-a9a8-48fdebe533b2 req-26b54826-b287-4115-bf24-be7ef94fbeaa service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Received unexpected event network-vif-plugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 for instance with vm_state building and task_state spawning.
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:25:44 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503944.8763597, 33394dd6-b87c-438d-a55c-4c530d308feb => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:25:44 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] VM Started (Lifecycle Event)
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:25:44 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:25:45 user nova-compute[70709]: INFO nova.compute.manager [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Took 6.65 seconds to spawn the instance on the hypervisor.
Jul 28 00:25:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:25:45 user nova-compute[70709]: INFO nova.compute.manager [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Took 7.52 seconds to build instance.
Jul 28 00:25:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c94d7617-8189-42d2-a060-6c9410a0f157 tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "33394dd6-b87c-438d-a55c-4c530d308feb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.621s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "c6297718-d595-4657-aa32-aa75bffdf955" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:47 user nova-compute[70709]: INFO nova.compute.manager [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Terminating instance
Jul 28 00:25:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:25:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-ba96be27-a216-460a-86c1-dd455023f4ef req-cd6486ef-bf94-4257-92b4-93d17df3651e service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-vif-unplugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ba96be27-a216-460a-86c1-dd455023f4ef req-cd6486ef-bf94-4257-92b4-93d17df3651e service nova] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ba96be27-a216-460a-86c1-dd455023f4ef req-cd6486ef-bf94-4257-92b4-93d17df3651e service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ba96be27-a216-460a-86c1-dd455023f4ef req-cd6486ef-bf94-4257-92b4-93d17df3651e service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-ba96be27-a216-460a-86c1-dd455023f4ef req-cd6486ef-bf94-4257-92b4-93d17df3651e service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] No waiting events found dispatching network-vif-unplugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-ba96be27-a216-460a-86c1-dd455023f4ef req-cd6486ef-bf94-4257-92b4-93d17df3651e service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-vif-unplugged-726f9120-5db5-4e03-aa01-07c310849ae4 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:48 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Instance destroyed successfully.
Jul 28 00:25:48 user nova-compute[70709]: DEBUG nova.objects.instance [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lazy-loading 'resources' on Instance uuid c6297718-d595-4657-aa32-aa75bffdf955 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1300495577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1300495577',id=16,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhz3b/+OTnnvXXqis9mWUuU2JeujnEQhRF8y6xBqEX+l661Wggc+ycz9K5OasbJCAPev99gjeXqePw3PUp7E6xsV1VpsbGc2qz8q5qhN08HuMfcuvAClChCXsU2M5EIjw==',key_name='tempest-keypair-1135389968',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:19:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='526ce0f27cc343a5ac86331ee21076ec',ramdisk_id='',reservation_id='r-4q8nn484',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1273279077',owner_user_name='tempest-ServerActionsV293TestJSON-1273279077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b436a6349354f97a81ea3977aec28a5',uuid=c6297718-d595-4657-aa32-aa75bffdf955,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "726f9120-5db5-4e03-aa01-07c310849ae4", "address": "fa:16:3e:85:c0:80", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f9120-5d", "ovs_interfaceid": "726f9120-5db5-4e03-aa01-07c310849ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converting VIF {"id": "726f9120-5db5-4e03-aa01-07c310849ae4", "address": "fa:16:3e:85:c0:80", "network": {"id": "41203492-2086-4a42-932d-edebbc56b5f0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1156774225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "526ce0f27cc343a5ac86331ee21076ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f9120-5d", "ovs_interfaceid": "726f9120-5db5-4e03-aa01-07c310849ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:c0:80,bridge_name='br-int',has_traffic_filtering=True,id=726f9120-5db5-4e03-aa01-07c310849ae4,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f9120-5d') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG os_vif [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:c0:80,bridge_name='br-int',has_traffic_filtering=True,id=726f9120-5db5-4e03-aa01-07c310849ae4,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f9120-5d') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap726f9120-5d, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:25:48 user nova-compute[70709]: INFO os_vif [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:c0:80,bridge_name='br-int',has_traffic_filtering=True,id=726f9120-5db5-4e03-aa01-07c310849ae4,network=Network(41203492-2086-4a42-932d-edebbc56b5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f9120-5d')
Jul 28 00:25:48 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Deleting instance files /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955_del
Jul 28 00:25:48 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Deletion of /opt/stack/data/nova/instances/c6297718-d595-4657-aa32-aa75bffdf955_del complete
Jul 28 00:25:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:48 user nova-compute[70709]: INFO nova.compute.manager [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 28 00:25:48 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:25:48 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: c6297718-d595-4657-aa32-aa75bffdf955] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:25:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] No waiting events found dispatching network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:50 user nova-compute[70709]: WARNING nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received unexpected event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 for instance with vm_state active and task_state deleting.
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] No waiting events found dispatching network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:50 user nova-compute[70709]: WARNING nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received unexpected event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 for instance with vm_state active and task_state deleting.
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] No waiting events found dispatching network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:50 user nova-compute[70709]: WARNING nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received unexpected event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 for instance with vm_state active and task_state deleting.
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-vif-unplugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] No waiting events found dispatching network-vif-unplugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2870e55-8a9a-439d-92c4-d5197dce9a61 req-31e134ce-eca6-4207-8a18-48c15f163b9d service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-vif-unplugged-726f9120-5db5-4e03-aa01-07c310849ae4 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:50 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Took 1.61 seconds to deallocate network for instance.
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:50 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Deleted allocations for instance c6297718-d595-4657-aa32-aa75bffdf955
Jul 28 00:25:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7a044ea3-e135-4bb2-b583-5c4b0712f4fe tempest-ServerActionsV293TestJSON-1273279077 tempest-ServerActionsV293TestJSON-1273279077-project-member] Lock "c6297718-d595-4657-aa32-aa75bffdf955" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.297s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-88dd8e5e-ec21-404d-901b-02b47a9b8bdf req-cfb02b67-05ac-42d4-bfae-8ef55eb84224 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-88dd8e5e-ec21-404d-901b-02b47a9b8bdf req-cfb02b67-05ac-42d4-bfae-8ef55eb84224 service nova] Acquiring lock "c6297718-d595-4657-aa32-aa75bffdf955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-88dd8e5e-ec21-404d-901b-02b47a9b8bdf req-cfb02b67-05ac-42d4-bfae-8ef55eb84224 service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-88dd8e5e-ec21-404d-901b-02b47a9b8bdf req-cfb02b67-05ac-42d4-bfae-8ef55eb84224 service nova] Lock "c6297718-d595-4657-aa32-aa75bffdf955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-88dd8e5e-ec21-404d-901b-02b47a9b8bdf req-cfb02b67-05ac-42d4-bfae-8ef55eb84224 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] No waiting events found dispatching network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:25:52 user nova-compute[70709]: WARNING nova.compute.manager [req-88dd8e5e-ec21-404d-901b-02b47a9b8bdf req-cfb02b67-05ac-42d4-bfae-8ef55eb84224 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received unexpected event network-vif-plugged-726f9120-5db5-4e03-aa01-07c310849ae4 for instance with vm_state deleted and task_state None.
Jul 28 00:25:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-88dd8e5e-ec21-404d-901b-02b47a9b8bdf req-cfb02b67-05ac-42d4-bfae-8ef55eb84224 service nova] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Received event network-vif-deleted-726f9120-5db5-4e03-aa01-07c310849ae4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:53 user nova-compute[70709]: DEBUG nova.compute.manager [req-9b976708-506a-405a-8657-2a05d3319d0a req-158a21b8-2f20-4787-964b-39dac89f8dcc service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Received event network-changed-c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:53 user nova-compute[70709]: DEBUG nova.compute.manager [req-9b976708-506a-405a-8657-2a05d3319d0a req-158a21b8-2f20-4787-964b-39dac89f8dcc service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Refreshing instance network info cache due to event network-changed-c7268a6f-cb7b-47b4-892d-510883262188. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:25:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9b976708-506a-405a-8657-2a05d3319d0a req-158a21b8-2f20-4787-964b-39dac89f8dcc service nova] Acquiring lock "refresh_cache-44753afd-489f-48fa-ae42-0abaf29c2306" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9b976708-506a-405a-8657-2a05d3319d0a req-158a21b8-2f20-4787-964b-39dac89f8dcc service nova] Acquired lock "refresh_cache-44753afd-489f-48fa-ae42-0abaf29c2306" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:53 user nova-compute[70709]: DEBUG nova.network.neutron [req-9b976708-506a-405a-8657-2a05d3319d0a req-158a21b8-2f20-4787-964b-39dac89f8dcc service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Refreshing network info cache for port c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:25:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:53 user nova-compute[70709]: DEBUG nova.network.neutron [req-9b976708-506a-405a-8657-2a05d3319d0a req-158a21b8-2f20-4787-964b-39dac89f8dcc service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Updated VIF entry in instance network info cache for port c7268a6f-cb7b-47b4-892d-510883262188. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:25:53 user nova-compute[70709]: DEBUG nova.network.neutron [req-9b976708-506a-405a-8657-2a05d3319d0a req-158a21b8-2f20-4787-964b-39dac89f8dcc service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Updating instance_info_cache with network_info: [{"id": "c7268a6f-cb7b-47b4-892d-510883262188", "address": "fa:16:3e:95:2b:56", "network": {"id": "712dd33a-511a-44f9-9d06-baf14dd4651c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-18894966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a044df80e01435e82b533b6392d5ea8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7268a6f-cb", "ovs_interfaceid": "c7268a6f-cb7b-47b4-892d-510883262188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9b976708-506a-405a-8657-2a05d3319d0a req-158a21b8-2f20-4787-964b-39dac89f8dcc service nova] Releasing lock "refresh_cache-44753afd-489f-48fa-ae42-0abaf29c2306" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:25:55 user nova-compute[70709]: INFO nova.compute.claims [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Claim successful on node user
Jul 28 00:25:55 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:25:55 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:25:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:25:55 user nova-compute[70709]: DEBUG nova.policy [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ed7d89a57234f37b4c578669bce4cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de9e1809a584c68905d4c0f42302f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:25:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:25:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:25:56 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Creating image(s)
Jul 28 00:25:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "/opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "/opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "/opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "156fd4e3962f8ba6de305b9dbb92460ef49b5a5f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "156fd4e3962f8ba6de305b9dbb92460ef49b5a5f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f.part --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f.part --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:56 user nova-compute[70709]: DEBUG nova.virt.images [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] 3622ee01-48a3-4e94-8d4d-a40d70322312 was qcow2, converting to raw {{(pid=70709) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 28 00:25:56 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:25:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f.part /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f.converted {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Successfully created port: e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f.part /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f.converted" returned: 0 in 0.276s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f.converted --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "156fd4e3962f8ba6de305b9dbb92460ef49b5a5f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.214s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "156fd4e3962f8ba6de305b9dbb92460ef49b5a5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "156fd4e3962f8ba6de305b9dbb92460ef49b5a5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f,backing_fmt=raw /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f,backing_fmt=raw /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk 1073741824" returned: 0 in 0.052s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "156fd4e3962f8ba6de305b9dbb92460ef49b5a5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "44753afd-489f-48fa-ae42-0abaf29c2306" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.objects.instance [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lazy-loading 'flavor' on Instance uuid 44753afd-489f-48fa-ae42-0abaf29c2306 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f --force-share --output=json" returned: 0 in 0.168s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Checking if we can resize image /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Successfully updated port: e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquired lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-7e7336d7-a19e-4e67-b4cc-687f007c99de req-4d0dcd45-2564-4d6a-80fb-6eed3c48af92 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-changed-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-7e7336d7-a19e-4e67-b4cc-687f007c99de req-4d0dcd45-2564-4d6a-80fb-6eed3c48af92 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Refreshing instance network info cache due to event network-changed-e3bd2d01-d61d-4d30-a088-13f85c724ce1. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7e7336d7-a19e-4e67-b4cc-687f007c99de req-4d0dcd45-2564-4d6a-80fb-6eed3c48af92 service nova] Acquiring lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "44753afd-489f-48fa-ae42-0abaf29c2306" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:57 user nova-compute[70709]: INFO nova.compute.manager [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Attaching volume bb3b8be3-79b2-4ef0-98bf-968e54a56c3e to /dev/vdb
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Cannot resize image /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.objects.instance [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'migration_context' on Instance uuid 560f0547-6eb6-4009-87ba-8206a77c27e8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Ensure instance console log exists: /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:25:57 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG os_brick.utils [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58802bd-bdf6-495a-844d-19a16639ac10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e864d9-ffe4-437d-b361-8e69e4f0e23b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2953cce2-eb50-41e5-91f3-4dd64a19ac3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b34642-9daf-4df9-ac74-23638ef5f6a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:25:58 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b83982-7a1e-4451-81f9-d5b0752dae56]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG os_brick.utils [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Updating existing volume attachment record: 5826787b-9336-48d9-8df0-3108cde2b9db {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.network.neutron [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updating instance_info_cache with network_info: [{"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Releasing lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Instance network_info: |[{"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7e7336d7-a19e-4e67-b4cc-687f007c99de req-4d0dcd45-2564-4d6a-80fb-6eed3c48af92 service nova] Acquired lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.network.neutron [req-7e7336d7-a19e-4e67-b4cc-687f007c99de req-4d0dcd45-2564-4d6a-80fb-6eed3c48af92 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Refreshing network info cache for port e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Start _get_guest_xml network_info=[{"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:25:52Z,direct_url=<?>,disk_format='qcow2',id=3622ee01-48a3-4e94-8d4d-a40d70322312,min_disk=0,min_ram=0,name='tempest-scenario-img--132454362',owner='1de9e1809a584c68905d4c0f42302f8c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:25:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '3622ee01-48a3-4e94-8d4d-a40d70322312'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:25:58 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:25:58 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:25:52Z,direct_url=<?>,disk_format='qcow2',id=3622ee01-48a3-4e94-8d4d-a40d70322312,min_disk=0,min_ram=0,name='tempest-scenario-img--132454362',owner='1de9e1809a584c68905d4c0f42302f8c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:25:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1988638140',display_name='tempest-TestMinimumBasicScenario-server-1988638140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1988638140',id=29,image_ref='3622ee01-48a3-4e94-8d4d-a40d70322312',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgAe7fbR4SblP2yMACJUHdyDB7WJ1j0thr34aLr8igg2l4nxcVawVH0BIxYTgl6DqiQd59f4HFOlHBZSpkCvXZOiCWrZdx7GQ/FSRIs8EtMgBIdcVMjRCcMMwqAgTi1fw==',key_name='tempest-TestMinimumBasicScenario-719932542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1de9e1809a584c68905d4c0f42302f8c',ramdisk_id='',reservation_id='r-u4bc4jc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3622ee01-48a3-4e94-8d4d-a40d70322312',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1435468286',owner_user_name='tempest-TestMinimumBasicScenario-1435468286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:25:56Z,user_data=None,user_id='9ed7d89a57234f37b4c578669bce4cdb',uuid=560f0547-6eb6-4009-87ba-8206a77c27e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converting VIF {"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:53:55,bridge_name='br-int',has_traffic_filtering=True,id=e3bd2d01-d61d-4d30-a088-13f85c724ce1,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bd2d01-d6') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.objects.instance [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'pci_devices' on Instance uuid 560f0547-6eb6-4009-87ba-8206a77c27e8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:25:58 user nova-compute[70709]:   <uuid>560f0547-6eb6-4009-87ba-8206a77c27e8</uuid>
Jul 28 00:25:58 user nova-compute[70709]:   <name>instance-0000001d</name>
Jul 28 00:25:58 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:25:58 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:25:58 user nova-compute[70709]:   <metadata>
Jul 28 00:25:58 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:25:58 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:25:58 user nova-compute[70709]:       <nova:name>tempest-TestMinimumBasicScenario-server-1988638140</nova:name>
Jul 28 00:25:58 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:25:58</nova:creationTime>
Jul 28 00:25:58 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:25:58 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:25:58 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:25:58 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:25:58 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:25:58 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:25:58 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:25:58 user nova-compute[70709]:       <nova:owner>
Jul 28 00:25:58 user nova-compute[70709]:         <nova:user uuid="9ed7d89a57234f37b4c578669bce4cdb">tempest-TestMinimumBasicScenario-1435468286-project-member</nova:user>
Jul 28 00:25:58 user nova-compute[70709]:         <nova:project uuid="1de9e1809a584c68905d4c0f42302f8c">tempest-TestMinimumBasicScenario-1435468286</nova:project>
Jul 28 00:25:58 user nova-compute[70709]:       </nova:owner>
Jul 28 00:25:58 user nova-compute[70709]:       <nova:root type="image" uuid="3622ee01-48a3-4e94-8d4d-a40d70322312"/>
Jul 28 00:25:58 user nova-compute[70709]:       <nova:ports>
Jul 28 00:25:58 user nova-compute[70709]:         <nova:port uuid="e3bd2d01-d61d-4d30-a088-13f85c724ce1">
Jul 28 00:25:58 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 28 00:25:58 user nova-compute[70709]:         </nova:port>
Jul 28 00:25:58 user nova-compute[70709]:       </nova:ports>
Jul 28 00:25:58 user nova-compute[70709]:     </nova:instance>
Jul 28 00:25:58 user nova-compute[70709]:   </metadata>
Jul 28 00:25:58 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:25:58 user nova-compute[70709]:     <system>
Jul 28 00:25:58 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:25:58 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:25:58 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:25:58 user nova-compute[70709]:       <entry name="serial">560f0547-6eb6-4009-87ba-8206a77c27e8</entry>
Jul 28 00:25:58 user nova-compute[70709]:       <entry name="uuid">560f0547-6eb6-4009-87ba-8206a77c27e8</entry>
Jul 28 00:25:58 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:25:58 user nova-compute[70709]:     </system>
Jul 28 00:25:58 user nova-compute[70709]:   </sysinfo>
Jul 28 00:25:58 user nova-compute[70709]:   <os>
Jul 28 00:25:58 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:25:58 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:25:58 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:25:58 user nova-compute[70709]:   </os>
Jul 28 00:25:58 user nova-compute[70709]:   <features>
Jul 28 00:25:58 user nova-compute[70709]:     <acpi/>
Jul 28 00:25:58 user nova-compute[70709]:     <apic/>
Jul 28 00:25:58 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:25:58 user nova-compute[70709]:   </features>
Jul 28 00:25:58 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:25:58 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:25:58 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:25:58 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:25:58 user nova-compute[70709]:   </clock>
Jul 28 00:25:58 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:25:58 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:25:58 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:25:58 user nova-compute[70709]:   </cpu>
Jul 28 00:25:58 user nova-compute[70709]:   <devices>
Jul 28 00:25:58 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:25:58 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:25:58 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk"/>
Jul 28 00:25:58 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:25:58 user nova-compute[70709]:     </disk>
Jul 28 00:25:58 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:25:58 user nova-compute[70709]:       <mac address="fa:16:3e:1e:53:55"/>
Jul 28 00:25:58 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:25:58 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:25:58 user nova-compute[70709]:       <target dev="tape3bd2d01-d6"/>
Jul 28 00:25:58 user nova-compute[70709]:     </interface>
Jul 28 00:25:58 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:25:58 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/console.log" append="off"/>
Jul 28 00:25:58 user nova-compute[70709]:     </serial>
Jul 28 00:25:58 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:25:58 user nova-compute[70709]:     <video>
Jul 28 00:25:58 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:25:58 user nova-compute[70709]:     </video>
Jul 28 00:25:58 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:25:58 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:25:58 user nova-compute[70709]:     </rng>
Jul 28 00:25:58 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:25:58 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:25:58 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:25:58 user nova-compute[70709]:     </memballoon>
Jul 28 00:25:58 user nova-compute[70709]:   </devices>
Jul 28 00:25:58 user nova-compute[70709]: </domain>
Jul 28 00:25:58 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1988638140',display_name='tempest-TestMinimumBasicScenario-server-1988638140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1988638140',id=29,image_ref='3622ee01-48a3-4e94-8d4d-a40d70322312',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgAe7fbR4SblP2yMACJUHdyDB7WJ1j0thr34aLr8igg2l4nxcVawVH0BIxYTgl6DqiQd59f4HFOlHBZSpkCvXZOiCWrZdx7GQ/FSRIs8EtMgBIdcVMjRCcMMwqAgTi1fw==',key_name='tempest-TestMinimumBasicScenario-719932542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1de9e1809a584c68905d4c0f42302f8c',ramdisk_id='',reservation_id='r-u4bc4jc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3622ee01-48a3-4e94-8d4d-a40d70322312',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1435468286',owner_user_name='tempest-TestMinimumBasicScenario-1435468286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:25:56Z,user_data=None,user_id='9ed7d89a57234f37b4c578669bce4cdb',uuid=560f0547-6eb6-4009-87ba-8206a77c27e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converting VIF {"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:53:55,bridge_name='br-int',has_traffic_filtering=True,id=e3bd2d01-d61d-4d30-a088-13f85c724ce1,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bd2d01-d6') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG os_vif [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:53:55,bridge_name='br-int',has_traffic_filtering=True,id=e3bd2d01-d61d-4d30-a088-13f85c724ce1,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bd2d01-d6') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3bd2d01-d6, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3bd2d01-d6, col_values=(('external_ids', {'iface-id': 'e3bd2d01-d61d-4d30-a088-13f85c724ce1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:53:55', 'vm-uuid': '560f0547-6eb6-4009-87ba-8206a77c27e8'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:25:58 user nova-compute[70709]: INFO os_vif [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:53:55,bridge_name='br-int',has_traffic_filtering=True,id=e3bd2d01-d61d-4d30-a088-13f85c724ce1,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bd2d01-d6')
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:25:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] No VIF found with MAC fa:16:3e:1e:53:55, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:25:59 user nova-compute[70709]: DEBUG nova.network.neutron [req-7e7336d7-a19e-4e67-b4cc-687f007c99de req-4d0dcd45-2564-4d6a-80fb-6eed3c48af92 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updated VIF entry in instance network info cache for port e3bd2d01-d61d-4d30-a088-13f85c724ce1. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:25:59 user nova-compute[70709]: DEBUG nova.network.neutron [req-7e7336d7-a19e-4e67-b4cc-687f007c99de req-4d0dcd45-2564-4d6a-80fb-6eed3c48af92 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updating instance_info_cache with network_info: [{"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:25:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7e7336d7-a19e-4e67-b4cc-687f007c99de req-4d0dcd45-2564-4d6a-80fb-6eed3c48af92 service nova] Releasing lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:26:00 user nova-compute[70709]: INFO nova.compute.claims [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Claim successful on node user
Jul 28 00:26:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-99fef4ed-6aac-44ca-be25-1e876076df0c req-5f92de4e-0aa1-4878-9fd9-9dd6800762cd service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-99fef4ed-6aac-44ca-be25-1e876076df0c req-5f92de4e-0aa1-4878-9fd9-9dd6800762cd service nova] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-99fef4ed-6aac-44ca-be25-1e876076df0c req-5f92de4e-0aa1-4878-9fd9-9dd6800762cd service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-99fef4ed-6aac-44ca-be25-1e876076df0c req-5f92de4e-0aa1-4878-9fd9-9dd6800762cd service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-99fef4ed-6aac-44ca-be25-1e876076df0c req-5f92de4e-0aa1-4878-9fd9-9dd6800762cd service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] No waiting events found dispatching network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:26:00 user nova-compute[70709]: WARNING nova.compute.manager [req-99fef4ed-6aac-44ca-be25-1e876076df0c req-5f92de4e-0aa1-4878-9fd9-9dd6800762cd service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received unexpected event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 for instance with vm_state building and task_state spawning.
Jul 28 00:26:00 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG nova.network.neutron [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:26:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:26:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:26:01 user nova-compute[70709]: INFO nova.virt.block_device [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Booting with volume-backed-image 51efbb04-1b4c-43c9-99e8-6467b05b27ad at /dev/vda
Jul 28 00:26:01 user nova-compute[70709]: DEBUG nova.policy [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa22ce59fc4742d4ab16292a8b3d6e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6929fa5cb2284dd8b94c387bf6e3fef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:26:01 user nova-compute[70709]: DEBUG nova.network.neutron [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Successfully created port: 24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503962.3918548, 560f0547-6eb6-4009-87ba-8206a77c27e8 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:26:02 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] VM Resumed (Lifecycle Event)
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:26:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Instance spawned successfully.
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:02 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503962.3936315, 560f0547-6eb6-4009-87ba-8206a77c27e8 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:26:02 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] VM Started (Lifecycle Event)
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:26:02 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:26:02 user nova-compute[70709]: INFO nova.compute.manager [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Took 6.58 seconds to spawn the instance on the hypervisor.
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-3c7f5013-ec5b-4af6-91fd-e1311a2a75c9 req-da5d3c16-7d54-498c-a8f5-3b2861d1e45b service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3c7f5013-ec5b-4af6-91fd-e1311a2a75c9 req-da5d3c16-7d54-498c-a8f5-3b2861d1e45b service nova] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3c7f5013-ec5b-4af6-91fd-e1311a2a75c9 req-da5d3c16-7d54-498c-a8f5-3b2861d1e45b service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3c7f5013-ec5b-4af6-91fd-e1311a2a75c9 req-da5d3c16-7d54-498c-a8f5-3b2861d1e45b service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-3c7f5013-ec5b-4af6-91fd-e1311a2a75c9 req-da5d3c16-7d54-498c-a8f5-3b2861d1e45b service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] No waiting events found dispatching network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:26:02 user nova-compute[70709]: WARNING nova.compute.manager [req-3c7f5013-ec5b-4af6-91fd-e1311a2a75c9 req-da5d3c16-7d54-498c-a8f5-3b2861d1e45b service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received unexpected event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 for instance with vm_state building and task_state spawning.
Jul 28 00:26:02 user nova-compute[70709]: INFO nova.compute.manager [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Took 7.42 seconds to build instance.
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Successfully updated port: 24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fc0b3772-5bed-45c7-97c2-bc9cc284347c tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.537s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquired lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-d65b05b5-b75b-4032-bd11-91a4d105ed14 req-84489f20-f472-41ac-8f12-0f112871f5d9 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-changed-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-d65b05b5-b75b-4032-bd11-91a4d105ed14 req-84489f20-f472-41ac-8f12-0f112871f5d9 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Refreshing instance network info cache due to event network-changed-24b5fc91-8612-423c-a94a-5759d0ad3cb2. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d65b05b5-b75b-4032-bd11-91a4d105ed14 req-84489f20-f472-41ac-8f12-0f112871f5d9 service nova] Acquiring lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:26:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:26:03 user nova-compute[70709]: DEBUG nova.network.neutron [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Updating instance_info_cache with network_info: [{"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:26:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Releasing lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:26:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Instance network_info: |[{"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:26:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d65b05b5-b75b-4032-bd11-91a4d105ed14 req-84489f20-f472-41ac-8f12-0f112871f5d9 service nova] Acquired lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:26:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-d65b05b5-b75b-4032-bd11-91a4d105ed14 req-84489f20-f472-41ac-8f12-0f112871f5d9 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Refreshing network info cache for port 24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:26:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:03 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690503948.4859416, c6297718-d595-4657-aa32-aa75bffdf955 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:26:03 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: c6297718-d595-4657-aa32-aa75bffdf955] VM Stopped (Lifecycle Event)
Jul 28 00:26:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-04db0556-4293-4030-be9c-2ea965eff49d None None] [instance: c6297718-d595-4657-aa32-aa75bffdf955] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-d65b05b5-b75b-4032-bd11-91a4d105ed14 req-84489f20-f472-41ac-8f12-0f112871f5d9 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Updated VIF entry in instance network info cache for port 24b5fc91-8612-423c-a94a-5759d0ad3cb2. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:26:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-d65b05b5-b75b-4032-bd11-91a4d105ed14 req-84489f20-f472-41ac-8f12-0f112871f5d9 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Updating instance_info_cache with network_info: [{"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:26:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d65b05b5-b75b-4032-bd11-91a4d105ed14 req-84489f20-f472-41ac-8f12-0f112871f5d9 service nova] Releasing lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:26:05 user nova-compute[70709]: INFO nova.compute.claims [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Claim successful on node user
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.network.neutron [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:26:05 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzeyjgdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:26:05 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:26:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:26:05 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:26:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:26:05 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.policy [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce5a156400ad4eb5840168ab290161d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4490eb04484a6c936f8268364f5458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093bf2f-a07d-46c9-8690-a3be1a7ca571]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:26:05 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:26:05 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Creating image(s)
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "/opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "/opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "/opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[504ccf2f-d5d6-4059-b5c1-51d23a954482]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e] added
Jul 28 00:26:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[038a954e-ff88-48e8-942f-b7add638831a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.097s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cbcb57-209d-448b-8a5e-79432d818856]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YzeyjgdF {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.158s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YzeyjgdF" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a82138-15d0-484a-b8aa-99eaecf55301]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YzeyjgdF'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14d4bb0-add7-456a-ba76-d8a165717f33]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d1d2de-53cf-46cf-840a-44cf404b33e9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:06 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:06 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:06 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:06 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[94020381-2268-43e1-a918-bca51680349b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e, portal: 172.16.0.220,3260]
Jul 28 00:26:06 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e, portal: 172.16.0.220,3260] successful.
Jul 28 00:26:06 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk 1073741824" returned: 0 in 0.057s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ede131-dc14-401b-9576-deb1ae9f184f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4c93e5-d4c2-4d48-9cb6-01f3228a1ace]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:06 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:06 user nova-compute[70709]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e (non-flash)
Jul 28 00:26:06 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:06 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:06 user nova-compute[70709]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e (non-flash)
Jul 28 00:26:06 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.485s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[094b7da9-40df-407c-a371-2ab23313339c]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzeyjgdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Cannot resize image /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG nova.objects.instance [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'migration_context' on Instance uuid f468456b-a0e5-4b79-a88d-a2303ce5920b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Ensure instance console log exists: /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG nova.network.neutron [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Successfully created port: 04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.utils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fb72c1-6a75-4caa-b8c8-04d39bec2787]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[496af8a8-1eec-46b0-9fb8-a63af1d589f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2400f0d0-33cb-4901-b825-f6e5d325deb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[499a213a-b595-4309-9264-aa8a6c3f10a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:26:06 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:26:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5719066-d236-4833-9981-28dd8cfe762e]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG os_brick.utils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:26:06 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Updating existing volume attachment record: bea8b248-0c60-4383-a1a5-57d97c5b3a0e {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.526s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] <== connect_volume: return (1527ms) {'type': 'block', 'scsi_wwn': '26165306630386563', 'path': '/dev/sdd'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165306630386563', 'path': '/dev/sdd'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG nova.objects.instance [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lazy-loading 'flavor' on Instance uuid 44753afd-489f-48fa-ae42-0abaf29c2306 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:26:07 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:26:07 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:26:07 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:26:07 user nova-compute[70709]:   <serial>bb3b8be3-79b2-4ef0-98bf-968e54a56c3e</serial>
Jul 28 00:26:07 user nova-compute[70709]: </disk>
Jul 28 00:26:07 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Successfully updated port: 04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "refresh_cache-f468456b-a0e5-4b79-a88d-a2303ce5920b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquired lock "refresh_cache-f468456b-a0e5-4b79-a88d-a2303ce5920b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-ec86d1c2-009d-4e23-aa1d-d45a4b1981d2 req-6e77db02-70e2-40eb-b3c3-c1f1403b165f service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-changed-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-ec86d1c2-009d-4e23-aa1d-d45a4b1981d2 req-6e77db02-70e2-40eb-b3c3-c1f1403b165f service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Refreshing instance network info cache due to event network-changed-04d723ad-66a0-49a0-af57-cb899673cc7b. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ec86d1c2-009d-4e23-aa1d-d45a4b1981d2 req-6e77db02-70e2-40eb-b3c3-c1f1403b165f service nova] Acquiring lock "refresh_cache-f468456b-a0e5-4b79-a88d-a2303ce5920b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:26:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] No VIF found with MAC fa:16:3e:95:2b:56, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3d1d63b4-4bae-4d0d-b2f3-132ec348fc48 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.186s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Updating instance_info_cache with network_info: [{"id": "04d723ad-66a0-49a0-af57-cb899673cc7b", "address": "fa:16:3e:55:de:9c", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d723ad-66", "ovs_interfaceid": "04d723ad-66a0-49a0-af57-cb899673cc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Releasing lock "refresh_cache-f468456b-a0e5-4b79-a88d-a2303ce5920b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Instance network_info: |[{"id": "04d723ad-66a0-49a0-af57-cb899673cc7b", "address": "fa:16:3e:55:de:9c", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d723ad-66", "ovs_interfaceid": "04d723ad-66a0-49a0-af57-cb899673cc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ec86d1c2-009d-4e23-aa1d-d45a4b1981d2 req-6e77db02-70e2-40eb-b3c3-c1f1403b165f service nova] Acquired lock "refresh_cache-f468456b-a0e5-4b79-a88d-a2303ce5920b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.network.neutron [req-ec86d1c2-009d-4e23-aa1d-d45a4b1981d2 req-6e77db02-70e2-40eb-b3c3-c1f1403b165f service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Refreshing network info cache for port 04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Start _get_guest_xml network_info=[{"id": "04d723ad-66a0-49a0-af57-cb899673cc7b", "address": "fa:16:3e:55:de:9c", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d723ad-66", "ovs_interfaceid": "04d723ad-66a0-49a0-af57-cb899673cc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:26:08 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:26:08 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-668339058',display_name='tempest-VolumesSnapshotTestJSON-instance-668339058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-668339058',id=31,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB95uvA7F6319/qhb68M6MXo/+wLfxyRWb3J1QysAovP7HVMM3nO+7uojoqdsc1nhvKS2sKijhVW7CfqryJt01afkBM8AH+e43qIO/fPiSBt6qQtRNlRSAPoC1hJWxw+zw==',key_name='tempest-keypair-401090212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4490eb04484a6c936f8268364f5458',ramdisk_id='',reservation_id='r-ta196hum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-720662141',owner_user_name='tempest-VolumesSnapshotTestJSON-720662141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:26:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce5a156400ad4eb5840168ab290161d1',uuid=f468456b-a0e5-4b79-a88d-a2303ce5920b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04d723ad-66a0-49a0-af57-cb899673cc7b", "address": "fa:16:3e:55:de:9c", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d723ad-66", "ovs_interfaceid": "04d723ad-66a0-49a0-af57-cb899673cc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converting VIF {"id": "04d723ad-66a0-49a0-af57-cb899673cc7b", "address": "fa:16:3e:55:de:9c", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d723ad-66", "ovs_interfaceid": "04d723ad-66a0-49a0-af57-cb899673cc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:de:9c,bridge_name='br-int',has_traffic_filtering=True,id=04d723ad-66a0-49a0-af57-cb899673cc7b,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d723ad-66') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'pci_devices' on Instance uuid f468456b-a0e5-4b79-a88d-a2303ce5920b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:26:08 user nova-compute[70709]:   <uuid>f468456b-a0e5-4b79-a88d-a2303ce5920b</uuid>
Jul 28 00:26:08 user nova-compute[70709]:   <name>instance-0000001f</name>
Jul 28 00:26:08 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:26:08 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:26:08 user nova-compute[70709]:   <metadata>
Jul 28 00:26:08 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:26:08 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:26:08 user nova-compute[70709]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-668339058</nova:name>
Jul 28 00:26:08 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:26:08</nova:creationTime>
Jul 28 00:26:08 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:26:08 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:26:08 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:26:08 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:26:08 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:26:08 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:26:08 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:26:08 user nova-compute[70709]:       <nova:owner>
Jul 28 00:26:08 user nova-compute[70709]:         <nova:user uuid="ce5a156400ad4eb5840168ab290161d1">tempest-VolumesSnapshotTestJSON-720662141-project-member</nova:user>
Jul 28 00:26:08 user nova-compute[70709]:         <nova:project uuid="ac4490eb04484a6c936f8268364f5458">tempest-VolumesSnapshotTestJSON-720662141</nova:project>
Jul 28 00:26:08 user nova-compute[70709]:       </nova:owner>
Jul 28 00:26:08 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:26:08 user nova-compute[70709]:       <nova:ports>
Jul 28 00:26:08 user nova-compute[70709]:         <nova:port uuid="04d723ad-66a0-49a0-af57-cb899673cc7b">
Jul 28 00:26:08 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 28 00:26:08 user nova-compute[70709]:         </nova:port>
Jul 28 00:26:08 user nova-compute[70709]:       </nova:ports>
Jul 28 00:26:08 user nova-compute[70709]:     </nova:instance>
Jul 28 00:26:08 user nova-compute[70709]:   </metadata>
Jul 28 00:26:08 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:26:08 user nova-compute[70709]:     <system>
Jul 28 00:26:08 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:26:08 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:26:08 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:26:08 user nova-compute[70709]:       <entry name="serial">f468456b-a0e5-4b79-a88d-a2303ce5920b</entry>
Jul 28 00:26:08 user nova-compute[70709]:       <entry name="uuid">f468456b-a0e5-4b79-a88d-a2303ce5920b</entry>
Jul 28 00:26:08 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:26:08 user nova-compute[70709]:     </system>
Jul 28 00:26:08 user nova-compute[70709]:   </sysinfo>
Jul 28 00:26:08 user nova-compute[70709]:   <os>
Jul 28 00:26:08 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:26:08 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:26:08 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:26:08 user nova-compute[70709]:   </os>
Jul 28 00:26:08 user nova-compute[70709]:   <features>
Jul 28 00:26:08 user nova-compute[70709]:     <acpi/>
Jul 28 00:26:08 user nova-compute[70709]:     <apic/>
Jul 28 00:26:08 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:26:08 user nova-compute[70709]:   </features>
Jul 28 00:26:08 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:26:08 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:26:08 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:26:08 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:26:08 user nova-compute[70709]:   </clock>
Jul 28 00:26:08 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:26:08 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:26:08 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:26:08 user nova-compute[70709]:   </cpu>
Jul 28 00:26:08 user nova-compute[70709]:   <devices>
Jul 28 00:26:08 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:26:08 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:26:08 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk"/>
Jul 28 00:26:08 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:26:08 user nova-compute[70709]:     </disk>
Jul 28 00:26:08 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:26:08 user nova-compute[70709]:       <mac address="fa:16:3e:55:de:9c"/>
Jul 28 00:26:08 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:26:08 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:26:08 user nova-compute[70709]:       <target dev="tap04d723ad-66"/>
Jul 28 00:26:08 user nova-compute[70709]:     </interface>
Jul 28 00:26:08 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:26:08 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/console.log" append="off"/>
Jul 28 00:26:08 user nova-compute[70709]:     </serial>
Jul 28 00:26:08 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:26:08 user nova-compute[70709]:     <video>
Jul 28 00:26:08 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:26:08 user nova-compute[70709]:     </video>
Jul 28 00:26:08 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:26:08 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:26:08 user nova-compute[70709]:     </rng>
Jul 28 00:26:08 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:26:08 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:26:08 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:26:08 user nova-compute[70709]:     </memballoon>
Jul 28 00:26:08 user nova-compute[70709]:   </devices>
Jul 28 00:26:08 user nova-compute[70709]: </domain>
Jul 28 00:26:08 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-668339058',display_name='tempest-VolumesSnapshotTestJSON-instance-668339058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-668339058',id=31,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB95uvA7F6319/qhb68M6MXo/+wLfxyRWb3J1QysAovP7HVMM3nO+7uojoqdsc1nhvKS2sKijhVW7CfqryJt01afkBM8AH+e43qIO/fPiSBt6qQtRNlRSAPoC1hJWxw+zw==',key_name='tempest-keypair-401090212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4490eb04484a6c936f8268364f5458',ramdisk_id='',reservation_id='r-ta196hum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-720662141',owner_user_name='tempest-VolumesSnapshotTestJSON-720662141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:26:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce5a156400ad4eb5840168ab290161d1',uuid=f468456b-a0e5-4b79-a88d-a2303ce5920b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04d723ad-66a0-49a0-af57-cb899673cc7b", "address": "fa:16:3e:55:de:9c", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d723ad-66", "ovs_interfaceid": "04d723ad-66a0-49a0-af57-cb899673cc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converting VIF {"id": "04d723ad-66a0-49a0-af57-cb899673cc7b", "address": "fa:16:3e:55:de:9c", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d723ad-66", "ovs_interfaceid": "04d723ad-66a0-49a0-af57-cb899673cc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:de:9c,bridge_name='br-int',has_traffic_filtering=True,id=04d723ad-66a0-49a0-af57-cb899673cc7b,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d723ad-66') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG os_vif [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:de:9c,bridge_name='br-int',has_traffic_filtering=True,id=04d723ad-66a0-49a0-af57-cb899673cc7b,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d723ad-66') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04d723ad-66, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04d723ad-66, col_values=(('external_ids', {'iface-id': '04d723ad-66a0-49a0-af57-cb899673cc7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:de:9c', 'vm-uuid': 'f468456b-a0e5-4b79-a88d-a2303ce5920b'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:08 user nova-compute[70709]: INFO os_vif [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:de:9c,bridge_name='br-int',has_traffic_filtering=True,id=04d723ad-66a0-49a0-af57-cb899673cc7b,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d723ad-66')
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] No VIF found with MAC fa:16:3e:55:de:9c, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.network.neutron [req-ec86d1c2-009d-4e23-aa1d-d45a4b1981d2 req-6e77db02-70e2-40eb-b3c3-c1f1403b165f service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Updated VIF entry in instance network info cache for port 04d723ad-66a0-49a0-af57-cb899673cc7b. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG nova.network.neutron [req-ec86d1c2-009d-4e23-aa1d-d45a4b1981d2 req-6e77db02-70e2-40eb-b3c3-c1f1403b165f service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Updating instance_info_cache with network_info: [{"id": "04d723ad-66a0-49a0-af57-cb899673cc7b", "address": "fa:16:3e:55:de:9c", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d723ad-66", "ovs_interfaceid": "04d723ad-66a0-49a0-af57-cb899673cc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:26:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ec86d1c2-009d-4e23-aa1d-d45a4b1981d2 req-6e77db02-70e2-40eb-b3c3-c1f1403b165f service nova] Releasing lock "refresh_cache-f468456b-a0e5-4b79-a88d-a2303ce5920b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:26:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-03def184-e712-46ca-8eef-593809547fd0 req-f5aa5e39-6b03-406a-99fd-a50c7c3048a3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-03def184-e712-46ca-8eef-593809547fd0 req-f5aa5e39-6b03-406a-99fd-a50c7c3048a3 service nova] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-03def184-e712-46ca-8eef-593809547fd0 req-f5aa5e39-6b03-406a-99fd-a50c7c3048a3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-03def184-e712-46ca-8eef-593809547fd0 req-f5aa5e39-6b03-406a-99fd-a50c7c3048a3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-03def184-e712-46ca-8eef-593809547fd0 req-f5aa5e39-6b03-406a-99fd-a50c7c3048a3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] No waiting events found dispatching network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:26:09 user nova-compute[70709]: WARNING nova.compute.manager [req-03def184-e712-46ca-8eef-593809547fd0 req-f5aa5e39-6b03-406a-99fd-a50c7c3048a3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received unexpected event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b for instance with vm_state building and task_state spawning.
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "44753afd-489f-48fa-ae42-0abaf29c2306" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:10 user nova-compute[70709]: INFO nova.compute.manager [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Detaching volume bb3b8be3-79b2-4ef0-98bf-968e54a56c3e
Jul 28 00:26:10 user nova-compute[70709]: INFO nova.virt.block_device [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Attempting to driver detach volume bb3b8be3-79b2-4ef0-98bf-968e54a56c3e from mountpoint /dev/vdb
Jul 28 00:26:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Attempting to detach device vdb from instance 44753afd-489f-48fa-ae42-0abaf29c2306 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:26:10 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:26:10 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:26:10 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:26:10 user nova-compute[70709]:   <serial>bb3b8be3-79b2-4ef0-98bf-968e54a56c3e</serial>
Jul 28 00:26:10 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:26:10 user nova-compute[70709]: </disk>
Jul 28 00:26:10 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:26:10 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Successfully detached device vdb from instance 44753afd-489f-48fa-ae42-0abaf29c2306 from the persistent domain config.
Jul 28 00:26:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44753afd-489f-48fa-ae42-0abaf29c2306 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:26:10 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:26:10 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:26:10 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:26:10 user nova-compute[70709]:   <serial>bb3b8be3-79b2-4ef0-98bf-968e54a56c3e</serial>
Jul 28 00:26:10 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:26:10 user nova-compute[70709]: </disk>
Jul 28 00:26:10 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690503970.710727, 44753afd-489f-48fa-ae42-0abaf29c2306 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44753afd-489f-48fa-ae42-0abaf29c2306 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:26:10 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Successfully detached device vdb from instance 44753afd-489f-48fa-ae42-0abaf29c2306 from the live domain config.
Jul 28 00:26:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzeyjgdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:26:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fd48ee-ef58-4cce-b871-61ba39b5061e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:26:10 user nova-compute[70709]: No targets found.
Jul 28 00:26:10 user nova-compute[70709]: iSNS:
Jul 28 00:26:10 user nova-compute[70709]: No targets found.
Jul 28 00:26:10 user nova-compute[70709]: STATIC:
Jul 28 00:26:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd
Jul 28 00:26:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:26:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:26:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e
Jul 28 00:26:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:26:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:26:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:26:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:26:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:26:10 user nova-compute[70709]: FIRMWARE:
Jul 28 00:26:10 user nova-compute[70709]: No targets found.
Jul 28 00:26:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:26:10 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:26:10 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[47832d3e-911b-4fde-9390-9048889628c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6335db-f706-4987-b05f-2d2e521ed686]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:10 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:10 user nova-compute[70709]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e (non-flash)
Jul 28 00:26:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:10 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:10 user nova-compute[70709]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e (non-flash)
Jul 28 00:26:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90192680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e'): ({'sdd'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Removing single pathed devices sdd {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[378b20e4-e252-4b59-a570-60f99f18c298]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[840e37a5-30f7-4b8d-bda4-2dc4421a2a34]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Flushing IO for device /dev/sdd {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f806662e-745e-4071-bde6-355bf1df6668]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1814f7c1-efd2-4638-9dfb-814ab8510dab]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[da65871d-a68c-4f78-bb9f-a455a02f2db7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7128d0-bdfd-4a48-9d98-647132e6aa1f]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e, portal: 172.16.0.220,3260]
Jul 28 00:26:11 user nova-compute[70709]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e, portal: 172.16.0.220,3260] successful.
Jul 28 00:26:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3b8be3-79b2-4ef0-98bf-968e54a56c3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[245b2cf8-305f-475e-9b4e-ceefcd433336]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] <== disconnect_volume: return (318ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.objects.instance [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lazy-loading 'flavor' on Instance uuid 44753afd-489f-48fa-ae42-0abaf29c2306 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-085961c0-b6f6-4497-9400-6e57b5133c71 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.747s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503971.9357467, f468456b-a0e5-4b79-a88d-a2303ce5920b => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:26:11 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] VM Resumed (Lifecycle Event)
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:26:11 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Instance spawned successfully.
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:11 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503971.9422948, f468456b-a0e5-4b79-a88d-a2303ce5920b => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:26:11 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] VM Started (Lifecycle Event)
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.compute.manager [req-4ddd8d09-8cab-4973-9e5e-d53091474513 req-c78b5256-ee38-4b84-812f-048435106761 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4ddd8d09-8cab-4973-9e5e-d53091474513 req-c78b5256-ee38-4b84-812f-048435106761 service nova] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4ddd8d09-8cab-4973-9e5e-d53091474513 req-c78b5256-ee38-4b84-812f-048435106761 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4ddd8d09-8cab-4973-9e5e-d53091474513 req-c78b5256-ee38-4b84-812f-048435106761 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.compute.manager [req-4ddd8d09-8cab-4973-9e5e-d53091474513 req-c78b5256-ee38-4b84-812f-048435106761 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] No waiting events found dispatching network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:26:11 user nova-compute[70709]: WARNING nova.compute.manager [req-4ddd8d09-8cab-4973-9e5e-d53091474513 req-c78b5256-ee38-4b84-812f-048435106761 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received unexpected event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b for instance with vm_state building and task_state spawning.
Jul 28 00:26:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:26:12 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:26:12 user nova-compute[70709]: INFO nova.compute.manager [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Took 6.14 seconds to spawn the instance on the hypervisor.
Jul 28 00:26:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:12 user nova-compute[70709]: INFO nova.compute.manager [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Took 7.06 seconds to build instance.
Jul 28 00:26:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7e5cf31b-ae73-4614-b932-b6b221cdd162 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.173s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:26:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:26:12 user nova-compute[70709]: INFO nova.compute.claims [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Claim successful on node user
Jul 28 00:26:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG nova.network.neutron [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:26:13 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:26:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG nova.policy [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3328a16a9f1f4311899b091ce8412ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96d74828e1479381106c4c6538ea78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:26:13 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Creating image(s)
Jul 28 00:26:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "/opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "/opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:13 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.186s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk 1073741824" returned: 0 in 0.052s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Successfully created port: c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Cannot resize image /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.objects.instance [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lazy-loading 'migration_context' on Instance uuid a8f0e31a-8842-4c6e-b7a2-0e733216cce1 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Ensure instance console log exists: /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:26:14 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Creating image(s)
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Ensure instance console log exists: /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Start _get_guest_xml network_info=[{"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'bea8b248-0c60-4383-a1a5-57d97c5b3a0e', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'compYVDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7f93835f-ae7f-430b-b30b-33a82ae6e2a2', 'attached_at': '', 'detached_at': '', 'volume_id': '143be64f-f3a7-4b09-a61a-f6b0b30c7f57', 'serial': '143be64f-f3a7-4b09-a61a-f6b0b30c7f57'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:26:14 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:26:14 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'compYVDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:26:14 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:26:14 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:26:14 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[072fc630-9da4-4e64-9c42-c043f9bf6601]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:26:14 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6f2e7b-d5bc-4c17-8921-be66e9af88ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57] added
Jul 28 00:26:14 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb35c645-b38b-44a0-b6af-e9038d7cee6d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f3ba83-081b-4cc4-bb94-999dca6ef721]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v compYVDC {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v compYVDC" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c018059-0618-4a32-acbc-47f2f0813471]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'compYVDC'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3123d8-fe3e-4281-a935-0abb986eed2e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[988e6e09-1c6f-48c7-a241-e21593e27f90]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:14 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:14 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:14 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:14 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc62dd32-2a15-4a4d-8d2c-bf9c4be3f601]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57, portal: 172.16.0.220,3260]
Jul 28 00:26:14 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57, portal: 172.16.0.220,3260] successful.
Jul 28 00:26:14 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd4a0bc-aa44-4d4e-b07f-3b247b21239a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbc4675-19d0-44c5-a183-9dc334c4d2e5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:14 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:14 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:26:14 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:14 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:14 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:26:14 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[974b3db1-89b8-4b17-8f2f-4e7add1a55e0]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:26:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'compYVDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.network.neutron [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Successfully updated port: c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "refresh_cache-a8f0e31a-8842-4c6e-b7a2-0e733216cce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquired lock "refresh_cache-a8f0e31a-8842-4c6e-b7a2-0e733216cce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.network.neutron [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-087b913b-b1db-4d39-9bfc-dab161e7ae96 req-338bb849-8aa5-48c4-8dcb-9db9d2f275d2 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Received event network-changed-c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-087b913b-b1db-4d39-9bfc-dab161e7ae96 req-338bb849-8aa5-48c4-8dcb-9db9d2f275d2 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Refreshing instance network info cache due to event network-changed-c50a6f65-91d2-47b6-a27c-9b3e39a96952. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-087b913b-b1db-4d39-9bfc-dab161e7ae96 req-338bb849-8aa5-48c4-8dcb-9db9d2f275d2 service nova] Acquiring lock "refresh_cache-a8f0e31a-8842-4c6e-b7a2-0e733216cce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.network.neutron [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.network.neutron [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Updating instance_info_cache with network_info: [{"id": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "address": "fa:16:3e:e5:3a:a2", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50a6f65-91", "ovs_interfaceid": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Releasing lock "refresh_cache-a8f0e31a-8842-4c6e-b7a2-0e733216cce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Instance network_info: |[{"id": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "address": "fa:16:3e:e5:3a:a2", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50a6f65-91", "ovs_interfaceid": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-087b913b-b1db-4d39-9bfc-dab161e7ae96 req-338bb849-8aa5-48c4-8dcb-9db9d2f275d2 service nova] Acquired lock "refresh_cache-a8f0e31a-8842-4c6e-b7a2-0e733216cce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.network.neutron [req-087b913b-b1db-4d39-9bfc-dab161e7ae96 req-338bb849-8aa5-48c4-8dcb-9db9d2f275d2 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Refreshing network info cache for port c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Start _get_guest_xml network_info=[{"id": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "address": "fa:16:3e:e5:3a:a2", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50a6f65-91", "ovs_interfaceid": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:26:15 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:26:15 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1598606518',display_name='tempest-ServersNegativeTestJSON-server-1598606518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1598606518',id=32,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c96d74828e1479381106c4c6538ea78',ramdisk_id='',reservation_id='r-f349n7f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-969661376',owner_user_name='tempest-ServersNegativeTestJSON-969661376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:26:14Z,user_data=None,user_id='3328a16a9f1f4311899b091ce8412ba5',uuid=a8f0e31a-8842-4c6e-b7a2-0e733216cce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "address": "fa:16:3e:e5:3a:a2", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50a6f65-91", "ovs_interfaceid": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converting VIF {"id": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "address": "fa:16:3e:e5:3a:a2", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50a6f65-91", "ovs_interfaceid": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:26:15 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=c50a6f65-91d2-47b6-a27c-9b3e39a96952,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50a6f65-91') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.objects.instance [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lazy-loading 'pci_devices' on Instance uuid a8f0e31a-8842-4c6e-b7a2-0e733216cce1 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23965376433663465', 'path': '/dev/sdd'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965376433663465', 'path': '/dev/sdd'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:26:16 user nova-compute[70709]:   <uuid>a8f0e31a-8842-4c6e-b7a2-0e733216cce1</uuid>
Jul 28 00:26:16 user nova-compute[70709]:   <name>instance-00000020</name>
Jul 28 00:26:16 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:26:16 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:26:16 user nova-compute[70709]:   <metadata>
Jul 28 00:26:16 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:26:16 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:name>tempest-ServersNegativeTestJSON-server-1598606518</nova:name>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:26:15</nova:creationTime>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:26:16 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:26:16 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:owner>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:user uuid="3328a16a9f1f4311899b091ce8412ba5">tempest-ServersNegativeTestJSON-969661376-project-member</nova:user>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:project uuid="5c96d74828e1479381106c4c6538ea78">tempest-ServersNegativeTestJSON-969661376</nova:project>
Jul 28 00:26:16 user nova-compute[70709]:       </nova:owner>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:ports>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:port uuid="c50a6f65-91d2-47b6-a27c-9b3e39a96952">
Jul 28 00:26:16 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 28 00:26:16 user nova-compute[70709]:         </nova:port>
Jul 28 00:26:16 user nova-compute[70709]:       </nova:ports>
Jul 28 00:26:16 user nova-compute[70709]:     </nova:instance>
Jul 28 00:26:16 user nova-compute[70709]:   </metadata>
Jul 28 00:26:16 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:26:16 user nova-compute[70709]:     <system>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="serial">a8f0e31a-8842-4c6e-b7a2-0e733216cce1</entry>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="uuid">a8f0e31a-8842-4c6e-b7a2-0e733216cce1</entry>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:26:16 user nova-compute[70709]:     </system>
Jul 28 00:26:16 user nova-compute[70709]:   </sysinfo>
Jul 28 00:26:16 user nova-compute[70709]:   <os>
Jul 28 00:26:16 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:26:16 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:26:16 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:26:16 user nova-compute[70709]:   </os>
Jul 28 00:26:16 user nova-compute[70709]:   <features>
Jul 28 00:26:16 user nova-compute[70709]:     <acpi/>
Jul 28 00:26:16 user nova-compute[70709]:     <apic/>
Jul 28 00:26:16 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:26:16 user nova-compute[70709]:   </features>
Jul 28 00:26:16 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:26:16 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:26:16 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:26:16 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:26:16 user nova-compute[70709]:   </clock>
Jul 28 00:26:16 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:26:16 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:26:16 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:26:16 user nova-compute[70709]:   </cpu>
Jul 28 00:26:16 user nova-compute[70709]:   <devices>
Jul 28 00:26:16 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:26:16 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:26:16 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk"/>
Jul 28 00:26:16 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:26:16 user nova-compute[70709]:     </disk>
Jul 28 00:26:16 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:26:16 user nova-compute[70709]:       <mac address="fa:16:3e:e5:3a:a2"/>
Jul 28 00:26:16 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:26:16 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:26:16 user nova-compute[70709]:       <target dev="tapc50a6f65-91"/>
Jul 28 00:26:16 user nova-compute[70709]:     </interface>
Jul 28 00:26:16 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:26:16 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/console.log" append="off"/>
Jul 28 00:26:16 user nova-compute[70709]:     </serial>
Jul 28 00:26:16 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:26:16 user nova-compute[70709]:     <video>
Jul 28 00:26:16 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:26:16 user nova-compute[70709]:     </video>
Jul 28 00:26:16 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:26:16 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:26:16 user nova-compute[70709]:     </rng>
Jul 28 00:26:16 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:26:16 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:26:16 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:26:16 user nova-compute[70709]:     </memballoon>
Jul 28 00:26:16 user nova-compute[70709]:   </devices>
Jul 28 00:26:16 user nova-compute[70709]: </domain>
Jul 28 00:26:16 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1598606518',display_name='tempest-ServersNegativeTestJSON-server-1598606518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1598606518',id=32,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c96d74828e1479381106c4c6538ea78',ramdisk_id='',reservation_id='r-f349n7f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-969661376',owner_user_name='tempest-ServersNegativeTestJSON-969661376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:26:14Z,user_data=None,user_id='3328a16a9f1f4311899b091ce8412ba5',uuid=a8f0e31a-8842-4c6e-b7a2-0e733216cce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "address": "fa:16:3e:e5:3a:a2", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50a6f65-91", "ovs_interfaceid": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converting VIF {"id": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "address": "fa:16:3e:e5:3a:a2", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50a6f65-91", "ovs_interfaceid": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=c50a6f65-91d2-47b6-a27c-9b3e39a96952,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50a6f65-91') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG os_vif [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=c50a6f65-91d2-47b6-a27c-9b3e39a96952,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50a6f65-91') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc50a6f65-91, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc50a6f65-91, col_values=(('external_ids', {'iface-id': 'c50a6f65-91d2-47b6-a27c-9b3e39a96952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:3a:a2', 'vm-uuid': 'a8f0e31a-8842-4c6e-b7a2-0e733216cce1'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-547250233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-547250233',id=30,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-fhh06lyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:26:01Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=7f93835f-ae7f-430b-b30b-33a82ae6e2a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:25:5c,bridge_name='br-int',has_traffic_filtering=True,id=24b5fc91-8612-423c-a94a-5759d0ad3cb2,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b5fc91-86') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.objects.instance [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:26:16 user nova-compute[70709]: INFO os_vif [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=c50a6f65-91d2-47b6-a27c-9b3e39a96952,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50a6f65-91')
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:26:16 user nova-compute[70709]:   <uuid>7f93835f-ae7f-430b-b30b-33a82ae6e2a2</uuid>
Jul 28 00:26:16 user nova-compute[70709]:   <name>instance-0000001e</name>
Jul 28 00:26:16 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:26:16 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:26:16 user nova-compute[70709]:   <metadata>
Jul 28 00:26:16 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:26:16 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-547250233</nova:name>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:26:14</nova:creationTime>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:26:16 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:26:16 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:owner>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:user uuid="fa22ce59fc4742d4ab16292a8b3d6e3f">tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member</nova:user>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:project uuid="6929fa5cb2284dd8b94c387bf6e3fef6">tempest-ServerBootFromVolumeStableRescueTest-2075329923</nova:project>
Jul 28 00:26:16 user nova-compute[70709]:       </nova:owner>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:26:16 user nova-compute[70709]:       <nova:ports>
Jul 28 00:26:16 user nova-compute[70709]:         <nova:port uuid="24b5fc91-8612-423c-a94a-5759d0ad3cb2">
Jul 28 00:26:16 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 28 00:26:16 user nova-compute[70709]:         </nova:port>
Jul 28 00:26:16 user nova-compute[70709]:       </nova:ports>
Jul 28 00:26:16 user nova-compute[70709]:     </nova:instance>
Jul 28 00:26:16 user nova-compute[70709]:   </metadata>
Jul 28 00:26:16 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:26:16 user nova-compute[70709]:     <system>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="serial">7f93835f-ae7f-430b-b30b-33a82ae6e2a2</entry>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="uuid">7f93835f-ae7f-430b-b30b-33a82ae6e2a2</entry>
Jul 28 00:26:16 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:26:16 user nova-compute[70709]:     </system>
Jul 28 00:26:16 user nova-compute[70709]:   </sysinfo>
Jul 28 00:26:16 user nova-compute[70709]:   <os>
Jul 28 00:26:16 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:26:16 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:26:16 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:26:16 user nova-compute[70709]:   </os>
Jul 28 00:26:16 user nova-compute[70709]:   <features>
Jul 28 00:26:16 user nova-compute[70709]:     <acpi/>
Jul 28 00:26:16 user nova-compute[70709]:     <apic/>
Jul 28 00:26:16 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:26:16 user nova-compute[70709]:   </features>
Jul 28 00:26:16 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:26:16 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:26:16 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:26:16 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:26:16 user nova-compute[70709]:   </clock>
Jul 28 00:26:16 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:26:16 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:26:16 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:26:16 user nova-compute[70709]:   </cpu>
Jul 28 00:26:16 user nova-compute[70709]:   <devices>
Jul 28 00:26:16 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:26:16 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:26:16 user nova-compute[70709]:       <source dev="/dev/sdd"/>
Jul 28 00:26:16 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:26:16 user nova-compute[70709]:       <serial>143be64f-f3a7-4b09-a61a-f6b0b30c7f57</serial>
Jul 28 00:26:16 user nova-compute[70709]:     </disk>
Jul 28 00:26:16 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:26:16 user nova-compute[70709]:       <mac address="fa:16:3e:8a:25:5c"/>
Jul 28 00:26:16 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:26:16 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:26:16 user nova-compute[70709]:       <target dev="tap24b5fc91-86"/>
Jul 28 00:26:16 user nova-compute[70709]:     </interface>
Jul 28 00:26:16 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:26:16 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/console.log" append="off"/>
Jul 28 00:26:16 user nova-compute[70709]:     </serial>
Jul 28 00:26:16 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:26:16 user nova-compute[70709]:     <video>
Jul 28 00:26:16 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:26:16 user nova-compute[70709]:     </video>
Jul 28 00:26:16 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:26:16 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:26:16 user nova-compute[70709]:     </rng>
Jul 28 00:26:16 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:26:16 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:26:16 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:26:16 user nova-compute[70709]:     </memballoon>
Jul 28 00:26:16 user nova-compute[70709]:   </devices>
Jul 28 00:26:16 user nova-compute[70709]: </domain>
Jul 28 00:26:16 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-547250233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-547250233',id=30,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-fhh06lyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:26:01Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=7f93835f-ae7f-430b-b30b-33a82ae6e2a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:25:5c,bridge_name='br-int',has_traffic_filtering=True,id=24b5fc91-8612-423c-a94a-5759d0ad3cb2,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b5fc91-86') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG os_vif [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:25:5c,bridge_name='br-int',has_traffic_filtering=True,id=24b5fc91-8612-423c-a94a-5759d0ad3cb2,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b5fc91-86') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24b5fc91-86, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24b5fc91-86, col_values=(('external_ids', {'iface-id': '24b5fc91-8612-423c-a94a-5759d0ad3cb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:25:5c', 'vm-uuid': '7f93835f-ae7f-430b-b30b-33a82ae6e2a2'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:16 user nova-compute[70709]: INFO os_vif [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:25:5c,bridge_name='br-int',has_traffic_filtering=True,id=24b5fc91-8612-423c-a94a-5759d0ad3cb2,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b5fc91-86')
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] No VIF found with MAC fa:16:3e:e5:3a:a2, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No VIF found with MAC fa:16:3e:8a:25:5c, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.network.neutron [req-087b913b-b1db-4d39-9bfc-dab161e7ae96 req-338bb849-8aa5-48c4-8dcb-9db9d2f275d2 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Updated VIF entry in instance network info cache for port c50a6f65-91d2-47b6-a27c-9b3e39a96952. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.network.neutron [req-087b913b-b1db-4d39-9bfc-dab161e7ae96 req-338bb849-8aa5-48c4-8dcb-9db9d2f275d2 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Updating instance_info_cache with network_info: [{"id": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "address": "fa:16:3e:e5:3a:a2", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50a6f65-91", "ovs_interfaceid": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-087b913b-b1db-4d39-9bfc-dab161e7ae96 req-338bb849-8aa5-48c4-8dcb-9db9d2f275d2 service nova] Releasing lock "refresh_cache-a8f0e31a-8842-4c6e-b7a2-0e733216cce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503981.3888535, 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] VM Resumed (Lifecycle Event)
Jul 28 00:26:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-a58d6742-91e5-4478-873b-cca96c740895 req-04944b54-161e-4b06-afcf-0b7aa5be607b service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Received event network-vif-plugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a58d6742-91e5-4478-873b-cca96c740895 req-04944b54-161e-4b06-afcf-0b7aa5be607b service nova] Acquiring lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a58d6742-91e5-4478-873b-cca96c740895 req-04944b54-161e-4b06-afcf-0b7aa5be607b service nova] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a58d6742-91e5-4478-873b-cca96c740895 req-04944b54-161e-4b06-afcf-0b7aa5be607b service nova] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-a58d6742-91e5-4478-873b-cca96c740895 req-04944b54-161e-4b06-afcf-0b7aa5be607b service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] No waiting events found dispatching network-vif-plugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:26:21 user nova-compute[70709]: WARNING nova.compute.manager [req-a58d6742-91e5-4478-873b-cca96c740895 req-04944b54-161e-4b06-afcf-0b7aa5be607b service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Received unexpected event network-vif-plugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 for instance with vm_state building and task_state spawning.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-8d7a48b1-63f6-4589-bcdd-f4a81c5b65a4 req-bf2ed73e-f1fe-4f5a-aa81-ad86d4144510 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8d7a48b1-63f6-4589-bcdd-f4a81c5b65a4 req-bf2ed73e-f1fe-4f5a-aa81-ad86d4144510 service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8d7a48b1-63f6-4589-bcdd-f4a81c5b65a4 req-bf2ed73e-f1fe-4f5a-aa81-ad86d4144510 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8d7a48b1-63f6-4589-bcdd-f4a81c5b65a4 req-bf2ed73e-f1fe-4f5a-aa81-ad86d4144510 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-8d7a48b1-63f6-4589-bcdd-f4a81c5b65a4 req-bf2ed73e-f1fe-4f5a-aa81-ad86d4144510 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:26:21 user nova-compute[70709]: WARNING nova.compute.manager [req-8d7a48b1-63f6-4589-bcdd-f4a81c5b65a4 req-bf2ed73e-f1fe-4f5a-aa81-ad86d4144510 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received unexpected event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with vm_state building and task_state spawning.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-0d8c7254-0a6a-48c5-b180-cca6988bf98f req-e60793c7-329f-4813-8231-ed64c8a956b5 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Received event network-vif-plugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0d8c7254-0a6a-48c5-b180-cca6988bf98f req-e60793c7-329f-4813-8231-ed64c8a956b5 service nova] Acquiring lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0d8c7254-0a6a-48c5-b180-cca6988bf98f req-e60793c7-329f-4813-8231-ed64c8a956b5 service nova] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0d8c7254-0a6a-48c5-b180-cca6988bf98f req-e60793c7-329f-4813-8231-ed64c8a956b5 service nova] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-0d8c7254-0a6a-48c5-b180-cca6988bf98f req-e60793c7-329f-4813-8231-ed64c8a956b5 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] No waiting events found dispatching network-vif-plugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:26:21 user nova-compute[70709]: WARNING nova.compute.manager [req-0d8c7254-0a6a-48c5-b180-cca6988bf98f req-e60793c7-329f-4813-8231-ed64c8a956b5 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Received unexpected event network-vif-plugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 for instance with vm_state building and task_state spawning.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-0b992518-4928-49e5-a039-f0046e37ce02 req-fe0a67ca-2276-41d7-addb-4fd1d3e59d5e service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0b992518-4928-49e5-a039-f0046e37ce02 req-fe0a67ca-2276-41d7-addb-4fd1d3e59d5e service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0b992518-4928-49e5-a039-f0046e37ce02 req-fe0a67ca-2276-41d7-addb-4fd1d3e59d5e service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0b992518-4928-49e5-a039-f0046e37ce02 req-fe0a67ca-2276-41d7-addb-4fd1d3e59d5e service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-0b992518-4928-49e5-a039-f0046e37ce02 req-fe0a67ca-2276-41d7-addb-4fd1d3e59d5e service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:26:21 user nova-compute[70709]: WARNING nova.compute.manager [req-0b992518-4928-49e5-a039-f0046e37ce02 req-fe0a67ca-2276-41d7-addb-4fd1d3e59d5e service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received unexpected event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with vm_state building and task_state spawning.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Instance spawned successfully.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:26:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:26:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=6986MB free_disk=25.17217254638672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503981.389427, 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] VM Started (Lifecycle Event)
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Instance spawned successfully.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503981.394784, a8f0e31a-8842-4c6e-b7a2-0e733216cce1 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] VM Resumed (Lifecycle Event)
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Took 7.20 seconds to spawn the instance on the hypervisor.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690503981.3965988, a8f0e31a-8842-4c6e-b7a2-0e733216cce1 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] VM Started (Lifecycle Event)
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Applying migration context for instance b451d103-db00-4cea-86ed-d23cab6120f5 as it has an incoming, in-progress migration 846dd87e-b530-4986-9a01-f330488137e5. Migration status is finished {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updating resource usage from migration 846dd87e-b530-4986-9a01-f330488137e5
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Took 8.18 seconds to spawn the instance on the hypervisor.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 44753afd-489f-48fa-ae42-0abaf29c2306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 773cf3d1-e98d-4002-bb1f-a3b33a36edac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 5fbef78b-fc10-46c8-8762-5471ca191316 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Migration 846dd87e-b530-4986-9a01-f330488137e5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b451d103-db00-4cea-86ed-d23cab6120f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 33394dd6-b87c-438d-a55c-4c530d308feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 560f0547-6eb6-4009-87ba-8206a77c27e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance f468456b-a0e5-4b79-a88d-a2303ce5920b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a8f0e31a-8842-4c6e-b7a2-0e733216cce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:26:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Took 21.68 seconds to build instance.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-56cf13c7-931f-4939-a0fe-4326081ae5de tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.795s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:21 user nova-compute[70709]: INFO nova.compute.manager [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Took 9.17 seconds to build instance.
Jul 28 00:26:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58daea6e-2dd3-4209-8717-d61afee28597 tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.293s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:22 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:26:22 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:26:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:26:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:26:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:26:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:26:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:26:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:26:24 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:26:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:26:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:26:25 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:26:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:26:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:26:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-0a3d50cb-699c-4465-9b31-0dea96288536 req-9813d6ed-78a3-4338-8479-a6a540d06717 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Received event network-changed-ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-0a3d50cb-699c-4465-9b31-0dea96288536 req-9813d6ed-78a3-4338-8479-a6a540d06717 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Refreshing instance network info cache due to event network-changed-ef4e9d67-7edd-45d8-93a2-6386992bbe38. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:26:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0a3d50cb-699c-4465-9b31-0dea96288536 req-9813d6ed-78a3-4338-8479-a6a540d06717 service nova] Acquiring lock "refresh_cache-779ac3df-ee2f-49a2-bb03-1a162eed34b0" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:26:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0a3d50cb-699c-4465-9b31-0dea96288536 req-9813d6ed-78a3-4338-8479-a6a540d06717 service nova] Acquired lock "refresh_cache-779ac3df-ee2f-49a2-bb03-1a162eed34b0" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:26:44 user nova-compute[70709]: DEBUG nova.network.neutron [req-0a3d50cb-699c-4465-9b31-0dea96288536 req-9813d6ed-78a3-4338-8479-a6a540d06717 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Refreshing network info cache for port ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:26:45 user nova-compute[70709]: DEBUG nova.network.neutron [req-0a3d50cb-699c-4465-9b31-0dea96288536 req-9813d6ed-78a3-4338-8479-a6a540d06717 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Updated VIF entry in instance network info cache for port ef4e9d67-7edd-45d8-93a2-6386992bbe38. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:26:45 user nova-compute[70709]: DEBUG nova.network.neutron [req-0a3d50cb-699c-4465-9b31-0dea96288536 req-9813d6ed-78a3-4338-8479-a6a540d06717 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Updating instance_info_cache with network_info: [{"id": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "address": "fa:16:3e:79:18:f5", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e9d67-7e", "ovs_interfaceid": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:26:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0a3d50cb-699c-4465-9b31-0dea96288536 req-9813d6ed-78a3-4338-8479-a6a540d06717 service nova] Releasing lock "refresh_cache-779ac3df-ee2f-49a2-bb03-1a162eed34b0" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:26:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG nova.objects.instance [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 779ac3df-ee2f-49a2-bb03-1a162eed34b0 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:48 user nova-compute[70709]: INFO nova.compute.manager [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Attaching volume 42b21d5a-4511-4eee-a432-3beea0ae4a99 to /dev/vdb
Jul 28 00:26:48 user nova-compute[70709]: DEBUG os_brick.utils [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a264ab11-4963-4af2-9459-5a70a0d6a0b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3397ca7a-8418-458a-8fbb-bef70dfa632b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa72de1-b0a4-4848-8c60-1a85164dc037]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e266c1d-a8a4-4e80-ba16-b1f40fb2a9b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:26:48 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:26:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d72833f-b419-492e-9bdf-42760262776b]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG os_brick.utils [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:26:48 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Updating existing volume attachment record: 258e0096-052d-4bdf-9182-c57fe144dedc {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:26:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-fc951229-bb22-4a01-bc12-6701f1b2b983 req-6c68844e-379e-4dd3-9dd6-b5bf09bc4402 service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Received event network-changed-898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:26:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-fc951229-bb22-4a01-bc12-6701f1b2b983 req-6c68844e-379e-4dd3-9dd6-b5bf09bc4402 service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Refreshing instance network info cache due to event network-changed-898f0691-1e6e-4a2e-a165-5a9f10387dda. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:26:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fc951229-bb22-4a01-bc12-6701f1b2b983 req-6c68844e-379e-4dd3-9dd6-b5bf09bc4402 service nova] Acquiring lock "refresh_cache-5fbef78b-fc10-46c8-8762-5471ca191316" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:26:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fc951229-bb22-4a01-bc12-6701f1b2b983 req-6c68844e-379e-4dd3-9dd6-b5bf09bc4402 service nova] Acquired lock "refresh_cache-5fbef78b-fc10-46c8-8762-5471ca191316" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:26:51 user nova-compute[70709]: DEBUG nova.network.neutron [req-fc951229-bb22-4a01-bc12-6701f1b2b983 req-6c68844e-379e-4dd3-9dd6-b5bf09bc4402 service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Refreshing network info cache for port 898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:26:52 user nova-compute[70709]: DEBUG nova.network.neutron [req-fc951229-bb22-4a01-bc12-6701f1b2b983 req-6c68844e-379e-4dd3-9dd6-b5bf09bc4402 service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Updated VIF entry in instance network info cache for port 898f0691-1e6e-4a2e-a165-5a9f10387dda. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:26:52 user nova-compute[70709]: DEBUG nova.network.neutron [req-fc951229-bb22-4a01-bc12-6701f1b2b983 req-6c68844e-379e-4dd3-9dd6-b5bf09bc4402 service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Updating instance_info_cache with network_info: [{"id": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "address": "fa:16:3e:f2:3a:3e", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898f0691-1e", "ovs_interfaceid": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:26:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-fc951229-bb22-4a01-bc12-6701f1b2b983 req-6c68844e-379e-4dd3-9dd6-b5bf09bc4402 service nova] Releasing lock "refresh_cache-5fbef78b-fc10-46c8-8762-5471ca191316" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:26:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "5fbef78b-fc10-46c8-8762-5471ca191316" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG nova.objects.instance [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'flavor' on Instance uuid 5fbef78b-fc10-46c8-8762-5471ca191316 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "5fbef78b-fc10-46c8-8762-5471ca191316" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:26:55 user nova-compute[70709]: INFO nova.compute.manager [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Attaching volume da80f92c-c07f-4aec-9368-ed2e832720c4 to /dev/vdb
Jul 28 00:26:55 user nova-compute[70709]: DEBUG os_brick.utils [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b9b2c0-554b-458a-8881-d2bc46617834]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b32dcf-6516-4fe4-91bf-0fb622bd411a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b382309-7ffe-4fd6-b77b-b6d63324db50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6ba351-4670-4fed-8459-25e7e6eeffe7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:26:55 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:26:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c247af09-b1b3-480d-95dc-477a99cb648f]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG os_brick.utils [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:26:55 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Updating existing volume attachment record: 5fe5d82f-8022-48d9-aafb-279a26f1930e {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTpwvCUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:26:56 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:26:56 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:26:56 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ba6659-07f7-46a6-95af-8f56dfa2096f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:26:56 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69f0de1-02c2-4e94-b65d-7dd2ef05784f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99] added
Jul 28 00:26:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a0c7c4-acee-4fc0-8837-bde8f6b3676c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[836aeb57-8c70-4dfd-851a-6b1c524538ef]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jTpwvCUO {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jTpwvCUO" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f452c9-ae36-4ce3-bc57-b3939bf34e5a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jTpwvCUO'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b399e1-c827-4fa1-8c60-ffdb2f9d2dca]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4066d1b-5311-4671-9e72-cb43a8e201fa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:56 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:56 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:26:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:56 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:56 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:26:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8c5927-188d-418b-8118-851c3d51a0b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99, portal: 172.16.0.220,3260]
Jul 28 00:26:56 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99, portal: 172.16.0.220,3260] successful.
Jul 28 00:26:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[050f99d7-cd66-41c6-b62d-a1797fca0d10]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd1a03b-4bb9-4738-b815-ef84f51a4c0d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:56 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:56 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:26:56 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:26:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:26:56 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:26:56 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:26:56 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:26:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[012e2e1a-b051-46d8-bf2f-8cf507626abc]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:26:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTpwvCUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:26:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:26:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:26:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23866353466316135', 'path': '/dev/sde'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:26:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866353466316135', 'path': '/dev/sde'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:26:57 user nova-compute[70709]: DEBUG nova.objects.instance [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 779ac3df-ee2f-49a2-bb03-1a162eed34b0 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:26:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:26:57 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:26:57 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:26:57 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:26:57 user nova-compute[70709]:   <serial>42b21d5a-4511-4eee-a432-3beea0ae4a99</serial>
Jul 28 00:26:57 user nova-compute[70709]: </disk>
Jul 28 00:26:57 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:26:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:26:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:26:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No VIF found with MAC fa:16:3e:79:18:f5, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:26:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dca8a81d-5a8e-4d7b-9caf-4abaf8d60b4e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.867s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:26:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:02 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 779ac3df-ee2f-49a2-bb03-1a162eed34b0 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:03 user nova-compute[70709]: INFO nova.compute.manager [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Attaching volume db42d72e-1364-4dc2-a601-26af189ad4ec to /dev/vdc
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.utils [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e011f0af-f5dc-48e9-b902-42749a9d1ad7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a015ec27-b04e-4c11-abee-243326fe414a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9878fd5-7129-4388-b48d-90bfb75f87b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7b0f4f-af7f-404c-8a2b-c08f9686341b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:27:03 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec89d384-4e04-4040-858a-9820a252dc6f]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.utils [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Updating existing volume attachment record: 4366071b-45de-4467-b21a-f38205f3cb54 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBtbSVwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:27:03 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:27:03 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:27:03 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf310322-6ac8-42ab-9e74-ef23c4fa4d57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:27:03 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9d16e1-1db8-4fc7-9185-2e54705657d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4] added
Jul 28 00:27:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b1a9d9-5501-4395-8c2c-7ecc25b5396c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4286efa7-a6bd-4d02-bf0a-a8ba2b4a2efd]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mBtbSVwf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mBtbSVwf" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca4456e-f352-4abf-b9d0-b98550a57b55]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mBtbSVwf'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b5569-8351-4dec-aa9e-6543ee40a06f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e80d58b-201a-451e-a9f3-8420a51bf476]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:03 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:03 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:03 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:03 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:03 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:03 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c23a822-b83b-4ea6-9af2-749b13848296]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4, portal: 172.16.0.220,3260]
Jul 28 00:27:03 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4, portal: 172.16.0.220,3260] successful.
Jul 28 00:27:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f40cc7-94f9-42b8-bf2e-a48ca5d0e96a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aa3069-2259-442f-bc67-4f7f7ce86f43]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:04 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:04 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:04 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:04 user nova-compute[70709]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 (non-flash)
Jul 28 00:27:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:04 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:04 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:04 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:04 user nova-compute[70709]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 (non-flash)
Jul 28 00:27:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5403c5fe-ce72-4906-b813-65f63f279f40]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:27:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBtbSVwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:27:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:27:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23536613735663739', 'path': '/dev/sdf'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:27:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536613735663739', 'path': '/dev/sdf'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:27:05 user nova-compute[70709]: DEBUG nova.objects.instance [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'flavor' on Instance uuid 5fbef78b-fc10-46c8-8762-5471ca191316 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:27:05 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:27:05 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:27:05 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:27:05 user nova-compute[70709]:   <serial>da80f92c-c07f-4aec-9368-ed2e832720c4</serial>
Jul 28 00:27:05 user nova-compute[70709]: </disk>
Jul 28 00:27:05 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:27:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:27:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:27:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] No VIF found with MAC fa:16:3e:f2:3a:3e, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:27:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dfab9760-fa8f-429b-ac27-da2f4b263d00 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.941s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "d602680c-94a4-4e0d-bfca-893873fdd80d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:27:06 user nova-compute[70709]: INFO nova.compute.claims [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Claim successful on node user
Jul 28 00:27:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG nova.network.neutron [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:27:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:27:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG nova.policy [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5740d1a26a6242db951f3283bed1c374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849c1603c3d6407fa7dafb0bef6af892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:27:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Creating image(s)
Jul 28 00:27:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "/opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "/opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "/opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "5fbef78b-fc10-46c8-8762-5471ca191316" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:07 user nova-compute[70709]: INFO nova.compute.manager [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Detaching volume da80f92c-c07f-4aec-9368-ed2e832720c4
Jul 28 00:27:07 user nova-compute[70709]: INFO nova.virt.block_device [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Attempting to driver detach volume da80f92c-c07f-4aec-9368-ed2e832720c4 from mountpoint /dev/vdb
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Attempting to detach device vdb from instance 5fbef78b-fc10-46c8-8762-5471ca191316 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:27:07 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:27:07 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:27:07 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:27:07 user nova-compute[70709]:   <serial>da80f92c-c07f-4aec-9368-ed2e832720c4</serial>
Jul 28 00:27:07 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:27:07 user nova-compute[70709]: </disk>
Jul 28 00:27:07 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:27:07 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully detached device vdb from instance 5fbef78b-fc10-46c8-8762-5471ca191316 from the persistent domain config.
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5fbef78b-fc10-46c8-8762-5471ca191316 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:27:07 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:27:07 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:27:07 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:27:07 user nova-compute[70709]:   <serial>da80f92c-c07f-4aec-9368-ed2e832720c4</serial>
Jul 28 00:27:07 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:27:07 user nova-compute[70709]: </disk>
Jul 28 00:27:07 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.296s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk 1073741824" returned: 0 in 0.056s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504027.5880656, 5fbef78b-fc10-46c8-8762-5471ca191316 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5fbef78b-fc10-46c8-8762-5471ca191316 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.180s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully detached device vdb from instance 5fbef78b-fc10-46c8-8762-5471ca191316 from the live domain config.
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Successfully created port: d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBtbSVwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:27:07 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[583f891e-1b1d-4f66-a0bc-37c93984c03e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:27:07 user nova-compute[70709]: No targets found.
Jul 28 00:27:07 user nova-compute[70709]: iSNS:
Jul 28 00:27:07 user nova-compute[70709]: No targets found.
Jul 28 00:27:07 user nova-compute[70709]: STATIC:
Jul 28 00:27:07 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd
Jul 28 00:27:07 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:07 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:07 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99
Jul 28 00:27:07 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:07 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:07 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:27:07 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:07 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:07 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57
Jul 28 00:27:07 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:07 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:07 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4
Jul 28 00:27:07 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:07 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:07 user nova-compute[70709]: FIRMWARE:
Jul 28 00:27:07 user nova-compute[70709]: No targets found.
Jul 28 00:27:07 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:27:07 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:27:07 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72aab7c-9688-4e02-9f0b-3f70f7068073]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Cannot resize image /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.objects.instance [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lazy-loading 'migration_context' on Instance uuid d602680c-94a4-4e0d-bfca-893873fdd80d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Ensure instance console log exists: /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6257b13c-ffc0-45e4-9b55-816e5702dd17]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:07 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:07 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:07 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:07 user nova-compute[70709]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 (non-flash)
Jul 28 00:27:07 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:07 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:07 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:07 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:07 user nova-compute[70709]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 (non-flash)
Jul 28 00:27:07 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b885e0af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4'): ({'sdf'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Removing single pathed devices sdf {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef4cb1c-58c2-4770-85c3-abe637ee37f9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1178f8-8fb4-4880-bb53-2de0eb28c83e]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Flushing IO for device /dev/sdf {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b9802a-4f24-4ad9-bd35-94578b5bf1a4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4f2f08-7053-4d6a-8c50-38fc04af9ece]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac20dfa-201f-4fc0-8df5-b88f56795a37]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded50a1f-50a8-4369-bd3b-83942c9f65df]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4, portal: 172.16.0.220,3260]
Jul 28 00:27:08 user nova-compute[70709]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4, portal: 172.16.0.220,3260] successful.
Jul 28 00:27:08 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da80f92c-c07f-4aec-9368-ed2e832720c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d235c791-35cb-4f6f-989c-e5e7c0c97d12]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] <== disconnect_volume: return (374ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "44753afd-489f-48fa-ae42-0abaf29c2306" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:08 user nova-compute[70709]: INFO nova.compute.manager [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Terminating instance
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.compute.manager [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-e32dbb1e-a7ea-4a02-8956-161664f43638 req-b50f9c18-f59a-44a7-99f2-e9e2540e0af6 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Received event network-vif-unplugged-c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e32dbb1e-a7ea-4a02-8956-161664f43638 req-b50f9c18-f59a-44a7-99f2-e9e2540e0af6 service nova] Acquiring lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e32dbb1e-a7ea-4a02-8956-161664f43638 req-b50f9c18-f59a-44a7-99f2-e9e2540e0af6 service nova] Lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e32dbb1e-a7ea-4a02-8956-161664f43638 req-b50f9c18-f59a-44a7-99f2-e9e2540e0af6 service nova] Lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-e32dbb1e-a7ea-4a02-8956-161664f43638 req-b50f9c18-f59a-44a7-99f2-e9e2540e0af6 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] No waiting events found dispatching network-vif-unplugged-c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-e32dbb1e-a7ea-4a02-8956-161664f43638 req-b50f9c18-f59a-44a7-99f2-e9e2540e0af6 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Received event network-vif-unplugged-c7268a6f-cb7b-47b4-892d-510883262188 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Successfully updated port: d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "refresh_cache-d602680c-94a4-4e0d-bfca-893873fdd80d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquired lock "refresh_cache-d602680c-94a4-4e0d-bfca-893873fdd80d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-dd348e54-cf8a-4393-9ad5-3af1bcf7d12c req-4a630ce0-cb09-46cb-94a2-0f19a27f1140 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Received event network-changed-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-dd348e54-cf8a-4393-9ad5-3af1bcf7d12c req-4a630ce0-cb09-46cb-94a2-0f19a27f1140 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Refreshing instance network info cache due to event network-changed-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dd348e54-cf8a-4393-9ad5-3af1bcf7d12c req-4a630ce0-cb09-46cb-94a2-0f19a27f1140 service nova] Acquiring lock "refresh_cache-d602680c-94a4-4e0d-bfca-893873fdd80d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'flavor' on Instance uuid 5fbef78b-fc10-46c8-8762-5471ca191316 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91f047e5-4177-4778-81c7-16610a8df712 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.950s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:08 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Instance destroyed successfully.
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lazy-loading 'resources' on Instance uuid 44753afd-489f-48fa-ae42-0abaf29c2306 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-174442115',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-174442115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1744421',id=24,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhS0DLdoRrjNsPWRKQM3/W37QhUr2bRgsoLA+rcHM8q9XNVa20uQjZf4FjRO2T/wZGK2JLUZx2yn4JR4ul9mx6JoFlgW5VeIZIYhfJa8bKYYDPDrnnKC+YTOyQ1DPjiHA==',key_name='tempest-keypair-1354676365',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:24:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a044df80e01435e82b533b6392d5ea8',ramdisk_id='',reservation_id='r-3ppw6f79',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837516742',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:24:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f3572ab427249b28aabc681b29619fb',uuid=44753afd-489f-48fa-ae42-0abaf29c2306,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7268a6f-cb7b-47b4-892d-510883262188", "address": "fa:16:3e:95:2b:56", "network": {"id": "712dd33a-511a-44f9-9d06-baf14dd4651c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-18894966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a044df80e01435e82b533b6392d5ea8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7268a6f-cb", "ovs_interfaceid": "c7268a6f-cb7b-47b4-892d-510883262188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Converting VIF {"id": "c7268a6f-cb7b-47b4-892d-510883262188", "address": "fa:16:3e:95:2b:56", "network": {"id": "712dd33a-511a-44f9-9d06-baf14dd4651c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-18894966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a044df80e01435e82b533b6392d5ea8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7268a6f-cb", "ovs_interfaceid": "c7268a6f-cb7b-47b4-892d-510883262188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:2b:56,bridge_name='br-int',has_traffic_filtering=True,id=c7268a6f-cb7b-47b4-892d-510883262188,network=Network(712dd33a-511a-44f9-9d06-baf14dd4651c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7268a6f-cb') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:27:08 user nova-compute[70709]: DEBUG os_vif [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:2b:56,bridge_name='br-int',has_traffic_filtering=True,id=c7268a6f-cb7b-47b4-892d-510883262188,network=Network(712dd33a-511a-44f9-9d06-baf14dd4651c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7268a6f-cb') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7268a6f-cb, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:09 user nova-compute[70709]: INFO os_vif [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:2b:56,bridge_name='br-int',has_traffic_filtering=True,id=c7268a6f-cb7b-47b4-892d-510883262188,network=Network(712dd33a-511a-44f9-9d06-baf14dd4651c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7268a6f-cb')
Jul 28 00:27:09 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Deleting instance files /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306_del
Jul 28 00:27:09 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Deletion of /opt/stack/data/nova/instances/44753afd-489f-48fa-ae42-0abaf29c2306_del complete
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.network.neutron [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Updating instance_info_cache with network_info: [{"id": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "address": "fa:16:3e:af:a4:94", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17926b1-62", "ovs_interfaceid": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Releasing lock "refresh_cache-d602680c-94a4-4e0d-bfca-893873fdd80d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Instance network_info: |[{"id": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "address": "fa:16:3e:af:a4:94", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17926b1-62", "ovs_interfaceid": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dd348e54-cf8a-4393-9ad5-3af1bcf7d12c req-4a630ce0-cb09-46cb-94a2-0f19a27f1140 service nova] Acquired lock "refresh_cache-d602680c-94a4-4e0d-bfca-893873fdd80d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.network.neutron [req-dd348e54-cf8a-4393-9ad5-3af1bcf7d12c req-4a630ce0-cb09-46cb-94a2-0f19a27f1140 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Refreshing network info cache for port d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Start _get_guest_xml network_info=[{"id": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "address": "fa:16:3e:af:a4:94", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17926b1-62", "ovs_interfaceid": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:27:09 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:27:09 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-135040119',display_name='tempest-VolumesActionsTest-instance-135040119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-135040119',id=33,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='849c1603c3d6407fa7dafb0bef6af892',ramdisk_id='',reservation_id='r-0cescark',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-385116109',owner_user_name='tempest-VolumesActionsTest-385116109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:27:07Z,user_data=None,user_id='5740d1a26a6242db951f3283bed1c374',uuid=d602680c-94a4-4e0d-bfca-893873fdd80d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "address": "fa:16:3e:af:a4:94", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17926b1-62", "ovs_interfaceid": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converting VIF {"id": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "address": "fa:16:3e:af:a4:94", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17926b1-62", "ovs_interfaceid": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:a4:94,bridge_name='br-int',has_traffic_filtering=True,id=d17926b1-62ca-41c6-a8c7-64ac24d2fd9a,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17926b1-62') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.objects.instance [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lazy-loading 'pci_devices' on Instance uuid d602680c-94a4-4e0d-bfca-893873fdd80d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:09 user nova-compute[70709]: INFO nova.compute.manager [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 28 00:27:09 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:27:09 user nova-compute[70709]:   <uuid>d602680c-94a4-4e0d-bfca-893873fdd80d</uuid>
Jul 28 00:27:09 user nova-compute[70709]:   <name>instance-00000021</name>
Jul 28 00:27:09 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:27:09 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:27:09 user nova-compute[70709]:   <metadata>
Jul 28 00:27:09 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:27:09 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:27:09 user nova-compute[70709]:       <nova:name>tempest-VolumesActionsTest-instance-135040119</nova:name>
Jul 28 00:27:09 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:27:09</nova:creationTime>
Jul 28 00:27:09 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:27:09 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:27:09 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:27:09 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:27:09 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:27:09 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:27:09 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:27:09 user nova-compute[70709]:       <nova:owner>
Jul 28 00:27:09 user nova-compute[70709]:         <nova:user uuid="5740d1a26a6242db951f3283bed1c374">tempest-VolumesActionsTest-385116109-project-member</nova:user>
Jul 28 00:27:09 user nova-compute[70709]:         <nova:project uuid="849c1603c3d6407fa7dafb0bef6af892">tempest-VolumesActionsTest-385116109</nova:project>
Jul 28 00:27:09 user nova-compute[70709]:       </nova:owner>
Jul 28 00:27:09 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:27:09 user nova-compute[70709]:       <nova:ports>
Jul 28 00:27:09 user nova-compute[70709]:         <nova:port uuid="d17926b1-62ca-41c6-a8c7-64ac24d2fd9a">
Jul 28 00:27:09 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 28 00:27:09 user nova-compute[70709]:         </nova:port>
Jul 28 00:27:09 user nova-compute[70709]:       </nova:ports>
Jul 28 00:27:09 user nova-compute[70709]:     </nova:instance>
Jul 28 00:27:09 user nova-compute[70709]:   </metadata>
Jul 28 00:27:09 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:27:09 user nova-compute[70709]:     <system>
Jul 28 00:27:09 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:27:09 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:27:09 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:27:09 user nova-compute[70709]:       <entry name="serial">d602680c-94a4-4e0d-bfca-893873fdd80d</entry>
Jul 28 00:27:09 user nova-compute[70709]:       <entry name="uuid">d602680c-94a4-4e0d-bfca-893873fdd80d</entry>
Jul 28 00:27:09 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:27:09 user nova-compute[70709]:     </system>
Jul 28 00:27:09 user nova-compute[70709]:   </sysinfo>
Jul 28 00:27:09 user nova-compute[70709]:   <os>
Jul 28 00:27:09 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:27:09 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:27:09 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:27:09 user nova-compute[70709]:   </os>
Jul 28 00:27:09 user nova-compute[70709]:   <features>
Jul 28 00:27:09 user nova-compute[70709]:     <acpi/>
Jul 28 00:27:09 user nova-compute[70709]:     <apic/>
Jul 28 00:27:09 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:27:09 user nova-compute[70709]:   </features>
Jul 28 00:27:09 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:27:09 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:27:09 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:27:09 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:27:09 user nova-compute[70709]:   </clock>
Jul 28 00:27:09 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:27:09 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:27:09 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:27:09 user nova-compute[70709]:   </cpu>
Jul 28 00:27:09 user nova-compute[70709]:   <devices>
Jul 28 00:27:09 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:27:09 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:27:09 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk"/>
Jul 28 00:27:09 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:27:09 user nova-compute[70709]:     </disk>
Jul 28 00:27:09 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:27:09 user nova-compute[70709]:       <mac address="fa:16:3e:af:a4:94"/>
Jul 28 00:27:09 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:27:09 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:27:09 user nova-compute[70709]:       <target dev="tapd17926b1-62"/>
Jul 28 00:27:09 user nova-compute[70709]:     </interface>
Jul 28 00:27:09 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:27:09 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/console.log" append="off"/>
Jul 28 00:27:09 user nova-compute[70709]:     </serial>
Jul 28 00:27:09 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:27:09 user nova-compute[70709]:     <video>
Jul 28 00:27:09 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:27:09 user nova-compute[70709]:     </video>
Jul 28 00:27:09 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:27:09 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:27:09 user nova-compute[70709]:     </rng>
Jul 28 00:27:09 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:27:09 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:27:09 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:27:09 user nova-compute[70709]:     </memballoon>
Jul 28 00:27:09 user nova-compute[70709]:   </devices>
Jul 28 00:27:09 user nova-compute[70709]: </domain>
Jul 28 00:27:09 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-135040119',display_name='tempest-VolumesActionsTest-instance-135040119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-135040119',id=33,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='849c1603c3d6407fa7dafb0bef6af892',ramdisk_id='',reservation_id='r-0cescark',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-385116109',owner_user_name='tempest-VolumesActionsTest-385116109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:27:07Z,user_data=None,user_id='5740d1a26a6242db951f3283bed1c374',uuid=d602680c-94a4-4e0d-bfca-893873fdd80d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "address": "fa:16:3e:af:a4:94", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17926b1-62", "ovs_interfaceid": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converting VIF {"id": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "address": "fa:16:3e:af:a4:94", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17926b1-62", "ovs_interfaceid": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:a4:94,bridge_name='br-int',has_traffic_filtering=True,id=d17926b1-62ca-41c6-a8c7-64ac24d2fd9a,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17926b1-62') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG os_vif [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:a4:94,bridge_name='br-int',has_traffic_filtering=True,id=d17926b1-62ca-41c6-a8c7-64ac24d2fd9a,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17926b1-62') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd17926b1-62, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd17926b1-62, col_values=(('external_ids', {'iface-id': 'd17926b1-62ca-41c6-a8c7-64ac24d2fd9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:a4:94', 'vm-uuid': 'd602680c-94a4-4e0d-bfca-893873fdd80d'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:09 user nova-compute[70709]: INFO os_vif [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:a4:94,bridge_name='br-int',has_traffic_filtering=True,id=d17926b1-62ca-41c6-a8c7-64ac24d2fd9a,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17926b1-62')
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] No VIF found with MAC fa:16:3e:af:a4:94, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.network.neutron [req-dd348e54-cf8a-4393-9ad5-3af1bcf7d12c req-4a630ce0-cb09-46cb-94a2-0f19a27f1140 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Updated VIF entry in instance network info cache for port d17926b1-62ca-41c6-a8c7-64ac24d2fd9a. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG nova.network.neutron [req-dd348e54-cf8a-4393-9ad5-3af1bcf7d12c req-4a630ce0-cb09-46cb-94a2-0f19a27f1140 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Updating instance_info_cache with network_info: [{"id": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "address": "fa:16:3e:af:a4:94", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17926b1-62", "ovs_interfaceid": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dd348e54-cf8a-4393-9ad5-3af1bcf7d12c req-4a630ce0-cb09-46cb-94a2-0f19a27f1140 service nova] Releasing lock "refresh_cache-d602680c-94a4-4e0d-bfca-893873fdd80d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:10 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Took 1.02 seconds to deallocate network for instance.
Jul 28 00:27:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-b3e61aa2-1043-415b-a5b2-2170695236d4 req-41e937b5-c134-46ab-93c9-f25f862d9969 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Received event network-vif-plugged-c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3e61aa2-1043-415b-a5b2-2170695236d4 req-41e937b5-c134-46ab-93c9-f25f862d9969 service nova] Acquiring lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3e61aa2-1043-415b-a5b2-2170695236d4 req-41e937b5-c134-46ab-93c9-f25f862d9969 service nova] Lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3e61aa2-1043-415b-a5b2-2170695236d4 req-41e937b5-c134-46ab-93c9-f25f862d9969 service nova] Lock "44753afd-489f-48fa-ae42-0abaf29c2306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-b3e61aa2-1043-415b-a5b2-2170695236d4 req-41e937b5-c134-46ab-93c9-f25f862d9969 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] No waiting events found dispatching network-vif-plugged-c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:10 user nova-compute[70709]: WARNING nova.compute.manager [req-b3e61aa2-1043-415b-a5b2-2170695236d4 req-41e937b5-c134-46ab-93c9-f25f862d9969 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Received unexpected event network-vif-plugged-c7268a6f-cb7b-47b4-892d-510883262188 for instance with vm_state deleted and task_state None.
Jul 28 00:27:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-b3e61aa2-1043-415b-a5b2-2170695236d4 req-41e937b5-c134-46ab-93c9-f25f862d9969 service nova] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Received event network-vif-deleted-c7268a6f-cb7b-47b4-892d-510883262188 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpHvwxGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:27:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:27:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:27:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:27:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:27:10 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:27:10 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Deleted allocations for instance 44753afd-489f-48fa-ae42-0abaf29c2306
Jul 28 00:27:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cfecdc-7def-4560-917a-4d7d1b61941c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:27:10 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c3fa73-b66b-47f1-9ab8-c4447d3c8364]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec] added
Jul 28 00:27:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec531b8-cb12-4282-ae37-fbab138260fd]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG nova.compute.manager [req-9ae77b7f-dcb7-4b61-a5d1-571206e84c8f req-0bac3ecc-e23c-44cc-8a88-00e5b32937e1 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Received event network-vif-plugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9ae77b7f-dcb7-4b61-a5d1-571206e84c8f req-0bac3ecc-e23c-44cc-8a88-00e5b32937e1 service nova] Acquiring lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9ae77b7f-dcb7-4b61-a5d1-571206e84c8f req-0bac3ecc-e23c-44cc-8a88-00e5b32937e1 service nova] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9ae77b7f-dcb7-4b61-a5d1-571206e84c8f req-0bac3ecc-e23c-44cc-8a88-00e5b32937e1 service nova] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG nova.compute.manager [req-9ae77b7f-dcb7-4b61-a5d1-571206e84c8f req-0bac3ecc-e23c-44cc-8a88-00e5b32937e1 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] No waiting events found dispatching network-vif-plugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:11 user nova-compute[70709]: WARNING nova.compute.manager [req-9ae77b7f-dcb7-4b61-a5d1-571206e84c8f req-0bac3ecc-e23c-44cc-8a88-00e5b32937e1 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Received unexpected event network-vif-plugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a for instance with vm_state building and task_state spawning.
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed652da-5c25-407d-8dd9-12dc431c5f50]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpHvwxGu {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpHvwxGu" returned: 0 in 0.039s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a9f98a-e164-4651-9738-c41d3cc1244d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RpHvwxGu'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-42f4a0b9-5502-4977-83b7-f010289f12ee tempest-TestServerVolumeAttachScenarioOldVersion-1837516742 tempest-TestServerVolumeAttachScenarioOldVersion-1837516742-project-member] Lock "44753afd-489f-48fa-ae42-0abaf29c2306" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac77e5f9-83d7-4cc8-8ec6-d00717abe8a5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9893be98-c476-4d18-b664-13ca8edfed33]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d3b176-46cd-4900-b769-c9bfc1d77569]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec, portal: 172.16.0.220,3260]
Jul 28 00:27:11 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec, portal: 172.16.0.220,3260] successful.
Jul 28 00:27:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e69c630-0e6a-4a03-80a6-79cd059fecc3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59fa968-fc5d-4d3c-94ae-e55927cd0feb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec (non-flash)
Jul 28 00:27:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:11 user nova-compute[70709]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec (non-flash)
Jul 28 00:27:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfa197a-5c54-4565-8a89-2d2dce61a931]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpHvwxGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23634346434626331', 'path': '/dev/sdf'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634346434626331', 'path': '/dev/sdf'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 779ac3df-ee2f-49a2-bb03-1a162eed34b0 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:27:12 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:27:12 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:27:12 user nova-compute[70709]:   <target dev="vdc" bus="virtio"/>
Jul 28 00:27:12 user nova-compute[70709]:   <serial>db42d72e-1364-4dc2-a601-26af189ad4ec</serial>
Jul 28 00:27:12 user nova-compute[70709]: </disk>
Jul 28 00:27:12 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b451d103-db00-4cea-86ed-d23cab6120f5" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Going to confirm migration 2 {{(pid=70709) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] No VIF found with MAC fa:16:3e:79:18:f5, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e2d570a8-b632-4a35-aff4-c498a054b745 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.774s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquired lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG nova.network.neutron [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:27:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'info_cache' on Instance uuid b451d103-db00-4cea-86ed-d23cab6120f5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504033.069185, d602680c-94a4-4e0d-bfca-893873fdd80d => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:27:13 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] VM Resumed (Lifecycle Event)
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:27:13 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Instance spawned successfully.
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:27:13 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504033.071992, d602680c-94a4-4e0d-bfca-893873fdd80d => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:27:13 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] VM Started (Lifecycle Event)
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.compute.manager [req-8e23e9cd-f35e-4107-99d4-be108c2c7193 req-e9a5b7a3-f6c5-4554-b25f-93b1ab8c88e1 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Received event network-vif-plugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8e23e9cd-f35e-4107-99d4-be108c2c7193 req-e9a5b7a3-f6c5-4554-b25f-93b1ab8c88e1 service nova] Acquiring lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8e23e9cd-f35e-4107-99d4-be108c2c7193 req-e9a5b7a3-f6c5-4554-b25f-93b1ab8c88e1 service nova] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8e23e9cd-f35e-4107-99d4-be108c2c7193 req-e9a5b7a3-f6c5-4554-b25f-93b1ab8c88e1 service nova] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.compute.manager [req-8e23e9cd-f35e-4107-99d4-be108c2c7193 req-e9a5b7a3-f6c5-4554-b25f-93b1ab8c88e1 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] No waiting events found dispatching network-vif-plugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:13 user nova-compute[70709]: WARNING nova.compute.manager [req-8e23e9cd-f35e-4107-99d4-be108c2c7193 req-e9a5b7a3-f6c5-4554-b25f-93b1ab8c88e1 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Received unexpected event network-vif-plugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a for instance with vm_state building and task_state spawning.
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:27:13 user nova-compute[70709]: INFO nova.compute.manager [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Took 6.28 seconds to spawn the instance on the hypervisor.
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:27:13 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:27:13 user nova-compute[70709]: INFO nova.compute.manager [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Took 7.13 seconds to build instance.
Jul 28 00:27:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-375c4395-213c-46d5-926a-85e6f5586406 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.323s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.network.neutron [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updating instance_info_cache with network_info: [{"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Releasing lock "refresh_cache-b451d103-db00-4cea-86ed-d23cab6120f5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.objects.instance [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'migration_context' on Instance uuid b451d103-db00-4cea-86ed-d23cab6120f5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:27:13 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:27:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.471s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:14 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Deleted allocation for migration 846dd87e-b530-4986-9a01-f330488137e5
Jul 28 00:27:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eeab4c61-54d5-4ea0-9800-2547929884a8 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b451d103-db00-4cea-86ed-d23cab6120f5" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.473s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:14 user nova-compute[70709]: INFO nova.compute.manager [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Detaching volume 42b21d5a-4511-4eee-a432-3beea0ae4a99
Jul 28 00:27:14 user nova-compute[70709]: INFO nova.virt.block_device [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Attempting to driver detach volume 42b21d5a-4511-4eee-a432-3beea0ae4a99 from mountpoint /dev/vdb
Jul 28 00:27:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Attempting to detach device vdb from instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:27:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:27:14 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:27:14 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:27:14 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:27:14 user nova-compute[70709]:   <serial>42b21d5a-4511-4eee-a432-3beea0ae4a99</serial>
Jul 28 00:27:14 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:27:14 user nova-compute[70709]: </disk>
Jul 28 00:27:14 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:27:14 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully detached device vdb from instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 from the persistent domain config.
Jul 28 00:27:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:27:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:27:14 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:27:14 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:27:14 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:27:14 user nova-compute[70709]:   <serial>42b21d5a-4511-4eee-a432-3beea0ae4a99</serial>
Jul 28 00:27:14 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:27:14 user nova-compute[70709]: </disk>
Jul 28 00:27:14 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504035.180139, 779ac3df-ee2f-49a2-bb03-1a162eed34b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:27:15 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully detached device vdb from instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 from the live domain config.
Jul 28 00:27:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTpwvCUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:27:15 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40767ce-7e53-473b-84a1-b78fae6e46bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:27:15 user nova-compute[70709]: No targets found.
Jul 28 00:27:15 user nova-compute[70709]: iSNS:
Jul 28 00:27:15 user nova-compute[70709]: No targets found.
Jul 28 00:27:15 user nova-compute[70709]: STATIC:
Jul 28 00:27:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd
Jul 28 00:27:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99
Jul 28 00:27:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:27:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57
Jul 28 00:27:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec
Jul 28 00:27:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:15 user nova-compute[70709]: FIRMWARE:
Jul 28 00:27:15 user nova-compute[70709]: No targets found.
Jul 28 00:27:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:27:15 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:27:15 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[579132fe-76f0-43cc-8478-56b73eb3676c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdfd5df-2d45-4143-b4b4-95a45001bb73]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:15 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:15 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:15 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:15 user nova-compute[70709]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec (non-flash)
Jul 28 00:27:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:15 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:15 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:15 user nova-compute[70709]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 (non-flash)
Jul 28 00:27:15 user nova-compute[70709]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec (non-flash)
Jul 28 00:27:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b901755a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99'): ({'sde'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Removing single pathed devices sde {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb26de87-f247-4ae6-b50d-4a9e08414b06]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cea752-f194-4991-a213-81c53aed9479]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flushing IO for device /dev/sde {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c43b9fd-14ac-47e3-a050-5530a99d809c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b88260-906c-4472-a892-76d38b68c013]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a18522-6b8f-4ed6-8999-1aae5d7c6fab]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf671067-0265-4776-8982-7a8b6518b106]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99, portal: 172.16.0.220,3260]
Jul 28 00:27:15 user nova-compute[70709]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99, portal: 172.16.0.220,3260] successful.
Jul 28 00:27:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42b21d5a-4511-4eee-a432-3beea0ae4a99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[68265634-9d5f-4486-ae5b-53add091b3a8]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] <== disconnect_volume: return (328ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:27:15 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:27:16 user nova-compute[70709]: DEBUG nova.objects.instance [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 779ac3df-ee2f-49a2-bb03-1a162eed34b0 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-de73eb2a-ca52-40ef-a223-8f15408686a1 tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.668s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:16 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:27:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: INFO nova.compute.manager [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Detaching volume db42d72e-1364-4dc2-a601-26af189ad4ec
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: INFO nova.virt.block_device [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Attempting to driver detach volume db42d72e-1364-4dc2-a601-26af189ad4ec from mountpoint /dev/vdc
Jul 28 00:27:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Attempting to detach device vdc from instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:27:17 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:27:17 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:27:17 user nova-compute[70709]:   <target dev="vdc" bus="virtio"/>
Jul 28 00:27:17 user nova-compute[70709]:   <serial>db42d72e-1364-4dc2-a601-26af189ad4ec</serial>
Jul 28 00:27:17 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 28 00:27:17 user nova-compute[70709]: </disk>
Jul 28 00:27:17 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:27:17 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully detached device vdc from instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 from the persistent domain config.
Jul 28 00:27:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:27:17 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:27:17 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:27:17 user nova-compute[70709]:   <target dev="vdc" bus="virtio"/>
Jul 28 00:27:17 user nova-compute[70709]:   <serial>db42d72e-1364-4dc2-a601-26af189ad4ec</serial>
Jul 28 00:27:17 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 28 00:27:17 user nova-compute[70709]: </disk>
Jul 28 00:27:17 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504037.72397, 779ac3df-ee2f-49a2-bb03-1a162eed34b0 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:27:17 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully detached device vdc from instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 from the live domain config.
Jul 28 00:27:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpHvwxGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:27:17 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f094d33-1f18-4271-b5ae-864c1c205b6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:27:17 user nova-compute[70709]: No targets found.
Jul 28 00:27:17 user nova-compute[70709]: iSNS:
Jul 28 00:27:17 user nova-compute[70709]: No targets found.
Jul 28 00:27:17 user nova-compute[70709]: STATIC:
Jul 28 00:27:17 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd
Jul 28 00:27:17 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:17 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:17 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:27:17 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:17 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:17 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57
Jul 28 00:27:17 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:17 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:17 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec
Jul 28 00:27:17 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:27:17 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:27:17 user nova-compute[70709]: FIRMWARE:
Jul 28 00:27:17 user nova-compute[70709]: No targets found.
Jul 28 00:27:17 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:27:17 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:27:17 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed1554a-68f6-419a-94f0-c44819209614]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc222522-3825-462d-ae4c-58fe06b975b8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:17 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:17 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:17 user nova-compute[70709]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec (non-flash)
Jul 28 00:27:17 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:17 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:17 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:17 user nova-compute[70709]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec (non-flash)
Jul 28 00:27:17 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b9d128700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec'): ({'sdf'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Removing single pathed devices sdf {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[584403cb-634d-44d0-9797-a1123358782d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8799e985-5358-4d8f-9bf2-d38f0102ac07]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Flushing IO for device /dev/sdf {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[69232e77-d49c-4110-a971-99dcfe3cab30]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7b6275-0207-4a0d-ba8e-76d173371460]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[69777d88-9973-4227-ae69-22d76f2ef85f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6887c1b5-aa75-418f-a290-cd19f67836b3]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec, portal: 172.16.0.220,3260]
Jul 28 00:27:18 user nova-compute[70709]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec, portal: 172.16.0.220,3260] successful.
Jul 28 00:27:18 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db42d72e-1364-4dc2-a601-26af189ad4ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e759295-cb7d-466d-8490-62d714a2b468]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] <== disconnect_volume: return (428ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'flavor' on Instance uuid 779ac3df-ee2f-49a2-bb03-1a162eed34b0 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e646041d-1998-46bb-8686-5856e1047aae tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.155s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:19 user nova-compute[70709]: INFO nova.compute.manager [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Terminating instance
Jul 28 00:27:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-9e06607f-1f6c-4755-8b51-43f041ed8482 req-4775a244-4f52-4c64-b62b-b8a93aec7a40 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Received event network-vif-unplugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9e06607f-1f6c-4755-8b51-43f041ed8482 req-4775a244-4f52-4c64-b62b-b8a93aec7a40 service nova] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9e06607f-1f6c-4755-8b51-43f041ed8482 req-4775a244-4f52-4c64-b62b-b8a93aec7a40 service nova] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9e06607f-1f6c-4755-8b51-43f041ed8482 req-4775a244-4f52-4c64-b62b-b8a93aec7a40 service nova] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-9e06607f-1f6c-4755-8b51-43f041ed8482 req-4775a244-4f52-4c64-b62b-b8a93aec7a40 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] No waiting events found dispatching network-vif-unplugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-9e06607f-1f6c-4755-8b51-43f041ed8482 req-4775a244-4f52-4c64-b62b-b8a93aec7a40 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Received event network-vif-unplugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:20 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Instance destroyed successfully.
Jul 28 00:27:20 user nova-compute[70709]: DEBUG nova.objects.instance [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lazy-loading 'resources' on Instance uuid 779ac3df-ee2f-49a2-bb03-1a162eed34b0 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-351485996',display_name='tempest-AttachVolumeTestJSON-server-351485996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-351485996',id=26,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzSfZ6wRq06WNCWcdZJMRzozsDKoM7q2zH2vBqFVLmht1oKEN3dxAmPdwsv2p4K7T3eoGwbcDsFmpO0an/9/9yasb08wlPOPQcSvszJ4OZ+bwpId66smPFlv3jbuIsJEA==',key_name='tempest-keypair-1369163009',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:25:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7063760e8f3340f88a0505a3cdcdbf7c',ramdisk_id='',reservation_id='r-3ydntjp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-693253624',owner_user_name='tempest-AttachVolumeTestJSON-693253624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c3a7c37bbe542008221fd2bcaf18f5c',uuid=779ac3df-ee2f-49a2-bb03-1a162eed34b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "address": "fa:16:3e:79:18:f5", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e9d67-7e", "ovs_interfaceid": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converting VIF {"id": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "address": "fa:16:3e:79:18:f5", "network": {"id": "6f798ed5-a185-4fad-9425-ba5e909a8b15", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-667017702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7063760e8f3340f88a0505a3cdcdbf7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e9d67-7e", "ovs_interfaceid": "ef4e9d67-7edd-45d8-93a2-6386992bbe38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:18:f5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e9d67-7edd-45d8-93a2-6386992bbe38,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e9d67-7e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG os_vif [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:18:f5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e9d67-7edd-45d8-93a2-6386992bbe38,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e9d67-7e') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef4e9d67-7e, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:27:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:27:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=6674MB free_disk=25.102405548095703GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:21 user nova-compute[70709]: INFO os_vif [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:18:f5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e9d67-7edd-45d8-93a2-6386992bbe38,network=Network(6f798ed5-a185-4fad-9425-ba5e909a8b15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e9d67-7e')
Jul 28 00:27:21 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Deleting instance files /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0_del
Jul 28 00:27:21 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Deletion of /opt/stack/data/nova/instances/779ac3df-ee2f-49a2-bb03-1a162eed34b0_del complete
Jul 28 00:27:21 user nova-compute[70709]: INFO nova.compute.manager [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Took 1.34 seconds to destroy the instance on the hypervisor.
Jul 28 00:27:21 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 773cf3d1-e98d-4002-bb1f-a3b33a36edac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 5fbef78b-fc10-46c8-8762-5471ca191316 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b451d103-db00-4cea-86ed-d23cab6120f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 33394dd6-b87c-438d-a55c-4c530d308feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 560f0547-6eb6-4009-87ba-8206a77c27e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance f468456b-a0e5-4b79-a88d-a2303ce5920b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a8f0e31a-8842-4c6e-b7a2-0e733216cce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance d602680c-94a4-4e0d-bfca-893873fdd80d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:27:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG nova.compute.manager [req-c08464ec-8c3b-463e-84f0-034f1c58a306 req-a472ec0a-97a8-4953-a1ae-a39e29dda504 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Received event network-vif-plugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c08464ec-8c3b-463e-84f0-034f1c58a306 req-a472ec0a-97a8-4953-a1ae-a39e29dda504 service nova] Acquiring lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c08464ec-8c3b-463e-84f0-034f1c58a306 req-a472ec0a-97a8-4953-a1ae-a39e29dda504 service nova] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c08464ec-8c3b-463e-84f0-034f1c58a306 req-a472ec0a-97a8-4953-a1ae-a39e29dda504 service nova] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG nova.compute.manager [req-c08464ec-8c3b-463e-84f0-034f1c58a306 req-a472ec0a-97a8-4953-a1ae-a39e29dda504 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] No waiting events found dispatching network-vif-plugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:22 user nova-compute[70709]: WARNING nova.compute.manager [req-c08464ec-8c3b-463e-84f0-034f1c58a306 req-a472ec0a-97a8-4953-a1ae-a39e29dda504 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Received unexpected event network-vif-plugged-ef4e9d67-7edd-45d8-93a2-6386992bbe38 for instance with vm_state active and task_state deleting.
Jul 28 00:27:22 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:22 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Took 1.13 seconds to deallocate network for instance.
Jul 28 00:27:22 user nova-compute[70709]: DEBUG nova.compute.manager [req-07b5f796-9f29-4726-943f-2b2801fc9c6c req-b2e96733-cacb-4b0d-b28f-13b535c18286 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Received event network-vif-deleted-ef4e9d67-7edd-45d8-93a2-6386992bbe38 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:22 user nova-compute[70709]: INFO nova.compute.manager [req-07b5f796-9f29-4726-943f-2b2801fc9c6c req-b2e96733-cacb-4b0d-b28f-13b535c18286 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Neutron deleted interface ef4e9d67-7edd-45d8-93a2-6386992bbe38; detaching it from the instance and deleting it from the info cache
Jul 28 00:27:22 user nova-compute[70709]: DEBUG nova.network.neutron [req-07b5f796-9f29-4726-943f-2b2801fc9c6c req-b2e96733-cacb-4b0d-b28f-13b535c18286 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG nova.compute.manager [req-07b5f796-9f29-4726-943f-2b2801fc9c6c req-b2e96733-cacb-4b0d-b28f-13b535c18286 service nova] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Detach interface failed, port_id=ef4e9d67-7edd-45d8-93a2-6386992bbe38, reason: Instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0 could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:27:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:22 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Deleted allocations for instance 779ac3df-ee2f-49a2-bb03-1a162eed34b0
Jul 28 00:27:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-07ce0929-0956-4d4d-95d4-911e55fee16e tempest-AttachVolumeTestJSON-693253624 tempest-AttachVolumeTestJSON-693253624-project-member] Lock "779ac3df-ee2f-49a2-bb03-1a162eed34b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.080s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:23 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504028.973598, 44753afd-489f-48fa-ae42-0abaf29c2306 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:27:23 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] VM Stopped (Lifecycle Event)
Jul 28 00:27:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-efec4de1-3963-4de5-9c67-6f66d95cca99 None None] [instance: 44753afd-489f-48fa-ae42-0abaf29c2306] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:27:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:27:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:27:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:27:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:27:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:27:26 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:27:26 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updating instance_info_cache with network_info: [{"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-b61aaab4-ca86-41e6-a576-a7174d89a284" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Acquiring lock "33394dd6-b87c-438d-a55c-4c530d308feb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "33394dd6-b87c-438d-a55c-4c530d308feb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Acquiring lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:27 user nova-compute[70709]: INFO nova.compute.manager [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Terminating instance
Jul 28 00:27:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a7aac54e-b9d8-4e6b-bed8-b972a12802f5 req-56494931-090a-4617-9cc1-5c8b620661d8 service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Received event network-vif-unplugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a7aac54e-b9d8-4e6b-bed8-b972a12802f5 req-56494931-090a-4617-9cc1-5c8b620661d8 service nova] Acquiring lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a7aac54e-b9d8-4e6b-bed8-b972a12802f5 req-56494931-090a-4617-9cc1-5c8b620661d8 service nova] Lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a7aac54e-b9d8-4e6b-bed8-b972a12802f5 req-56494931-090a-4617-9cc1-5c8b620661d8 service nova] Lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a7aac54e-b9d8-4e6b-bed8-b972a12802f5 req-56494931-090a-4617-9cc1-5c8b620661d8 service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] No waiting events found dispatching network-vif-unplugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-a7aac54e-b9d8-4e6b-bed8-b972a12802f5 req-56494931-090a-4617-9cc1-5c8b620661d8 service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Received event network-vif-unplugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:27:28 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Instance destroyed successfully.
Jul 28 00:27:28 user nova-compute[70709]: DEBUG nova.objects.instance [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lazy-loading 'resources' on Instance uuid 33394dd6-b87c-438d-a55c-4c530d308feb {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-600454763',display_name='tempest-VolumesNegativeTest-instance-600454763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-600454763',id=28,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5313d36ce88544ae80e7b9ec6f026a36',ramdisk_id='',reservation_id='r-0rjraqiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1368927597',owner_user_name='tempest-VolumesNegativeTest-1368927597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:25:45Z,user_data=None,user_id='06adcab697af44a4a122dd90bd4df02a',uuid=33394dd6-b87c-438d-a55c-4c530d308feb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "address": "fa:16:3e:75:a8:8c", "network": {"id": "4a34050d-91e7-4e28-bc8a-ef9857c9f6ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dfaa8247d31a480f99168e883a0b1888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fefc47c-0c", "ovs_interfaceid": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:27:28 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Converting VIF {"id": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "address": "fa:16:3e:75:a8:8c", "network": {"id": "4a34050d-91e7-4e28-bc8a-ef9857c9f6ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dfaa8247d31a480f99168e883a0b1888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fefc47c-0c", "ovs_interfaceid": "6fefc47c-0c33-4de6-8b35-7fdf6b61f824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:27:28 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a8:8c,bridge_name='br-int',has_traffic_filtering=True,id=6fefc47c-0c33-4de6-8b35-7fdf6b61f824,network=Network(4a34050d-91e7-4e28-bc8a-ef9857c9f6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fefc47c-0c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:27:28 user nova-compute[70709]: DEBUG os_vif [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a8:8c,bridge_name='br-int',has_traffic_filtering=True,id=6fefc47c-0c33-4de6-8b35-7fdf6b61f824,network=Network(4a34050d-91e7-4e28-bc8a-ef9857c9f6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fefc47c-0c') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:27:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fefc47c-0c, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:27:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:28 user nova-compute[70709]: INFO os_vif [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a8:8c,bridge_name='br-int',has_traffic_filtering=True,id=6fefc47c-0c33-4de6-8b35-7fdf6b61f824,network=Network(4a34050d-91e7-4e28-bc8a-ef9857c9f6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fefc47c-0c')
Jul 28 00:27:28 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Deleting instance files /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb_del
Jul 28 00:27:28 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Deletion of /opt/stack/data/nova/instances/33394dd6-b87c-438d-a55c-4c530d308feb_del complete
Jul 28 00:27:28 user nova-compute[70709]: INFO nova.compute.manager [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 28 00:27:28 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:27:28 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:27:28 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:27:28 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:28 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Took 0.49 seconds to deallocate network for instance.
Jul 28 00:27:28 user nova-compute[70709]: DEBUG nova.compute.manager [req-ac47cccc-d100-4197-ab2d-32d0bfc75b22 req-17cea05c-d6e2-4cca-a369-6b8853af13d1 service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Received event network-vif-deleted-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:28 user nova-compute[70709]: INFO nova.compute.manager [req-ac47cccc-d100-4197-ab2d-32d0bfc75b22 req-17cea05c-d6e2-4cca-a369-6b8853af13d1 service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Neutron deleted interface 6fefc47c-0c33-4de6-8b35-7fdf6b61f824; detaching it from the instance and deleting it from the info cache
Jul 28 00:27:28 user nova-compute[70709]: DEBUG nova.network.neutron [req-ac47cccc-d100-4197-ab2d-32d0bfc75b22 req-17cea05c-d6e2-4cca-a369-6b8853af13d1 service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-ac47cccc-d100-4197-ab2d-32d0bfc75b22 req-17cea05c-d6e2-4cca-a369-6b8853af13d1 service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Detach interface failed, port_id=6fefc47c-0c33-4de6-8b35-7fdf6b61f824, reason: Instance 33394dd6-b87c-438d-a55c-4c530d308feb could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:29 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Deleted allocations for instance 33394dd6-b87c-438d-a55c-4c530d308feb
Jul 28 00:27:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0e634f3e-f3e0-4143-91ba-8fe0447d91bd tempest-VolumesNegativeTest-1368927597 tempest-VolumesNegativeTest-1368927597-project-member] Lock "33394dd6-b87c-438d-a55c-4c530d308feb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.873s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-a7ee1ac8-4f09-4b85-88be-40965da918e5 req-507d65f3-2a2e-4ef5-bf5a-8c9554552ff5 service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Received event network-vif-plugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a7ee1ac8-4f09-4b85-88be-40965da918e5 req-507d65f3-2a2e-4ef5-bf5a-8c9554552ff5 service nova] Acquiring lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a7ee1ac8-4f09-4b85-88be-40965da918e5 req-507d65f3-2a2e-4ef5-bf5a-8c9554552ff5 service nova] Lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a7ee1ac8-4f09-4b85-88be-40965da918e5 req-507d65f3-2a2e-4ef5-bf5a-8c9554552ff5 service nova] Lock "33394dd6-b87c-438d-a55c-4c530d308feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-a7ee1ac8-4f09-4b85-88be-40965da918e5 req-507d65f3-2a2e-4ef5-bf5a-8c9554552ff5 service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] No waiting events found dispatching network-vif-plugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:29 user nova-compute[70709]: WARNING nova.compute.manager [req-a7ee1ac8-4f09-4b85-88be-40965da918e5 req-507d65f3-2a2e-4ef5-bf5a-8c9554552ff5 service nova] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Received unexpected event network-vif-plugged-6fefc47c-0c33-4de6-8b35-7fdf6b61f824 for instance with vm_state deleted and task_state None.
Jul 28 00:27:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:35 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504040.5767944, 779ac3df-ee2f-49a2-bb03-1a162eed34b0 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:27:35 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] VM Stopped (Lifecycle Event)
Jul 28 00:27:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c5bbf559-2176-4639-b414-086cad8ef9c5 None None] [instance: 779ac3df-ee2f-49a2-bb03-1a162eed34b0] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:27:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:43 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504048.3838363, 33394dd6-b87c-438d-a55c-4c530d308feb => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:27:43 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] VM Stopped (Lifecycle Event)
Jul 28 00:27:43 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e9bb17c4-b3c3-4ab1-a4d1-961e90ed4d19 None None] [instance: 33394dd6-b87c-438d-a55c-4c530d308feb] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:27:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG nova.objects.instance [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'flavor' on Instance uuid 560f0547-6eb6-4009-87ba-8206a77c27e8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:49 user nova-compute[70709]: INFO nova.compute.manager [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Attaching volume 94d4109b-f33a-4d07-9581-1e35034847d4 to /dev/vdb
Jul 28 00:27:49 user nova-compute[70709]: DEBUG os_brick.utils [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[364bee45-edfd-43c3-a438-00a843688761]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0288fc4-1479-4782-ba93-51ebb9f2ad21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e7027c-a2c6-404f-9c00-99ab5e43eff4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11ee38c-f9bd-487d-bd65-24fe30bd852b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:27:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:27:50 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:27:50 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e521a2-df5d-41a9-a46b-ea3fdfce10e3]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:27:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:27:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:27:50 user nova-compute[70709]: DEBUG os_brick.utils [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:27:50 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updating existing volume attachment record: b24b61a8-1c74-4d74-b0aa-67d4600ea27a {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:27:50 user nova-compute[70709]: INFO nova.compute.manager [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Rescuing
Jul 28 00:27:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:27:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquired lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:27:50 user nova-compute[70709]: DEBUG nova.network.neutron [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:27:51 user nova-compute[70709]: DEBUG nova.network.neutron [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Updating instance_info_cache with network_info: [{"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Releasing lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:27:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-784f1d59-36ea-4d46-adeb-774f5b65471f req-c35db221-5649-4235-a14a-e9e064247d84 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-unplugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-784f1d59-36ea-4d46-adeb-774f5b65471f req-c35db221-5649-4235-a14a-e9e064247d84 service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-784f1d59-36ea-4d46-adeb-774f5b65471f req-c35db221-5649-4235-a14a-e9e064247d84 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-784f1d59-36ea-4d46-adeb-774f5b65471f req-c35db221-5649-4235-a14a-e9e064247d84 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-784f1d59-36ea-4d46-adeb-774f5b65471f req-c35db221-5649-4235-a14a-e9e064247d84 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-unplugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:51 user nova-compute[70709]: WARNING nova.compute.manager [req-784f1d59-36ea-4d46-adeb-774f5b65471f req-c35db221-5649-4235-a14a-e9e064247d84 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received unexpected event network-vif-unplugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with vm_state active and task_state rescuing.
Jul 28 00:27:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Instance destroyed successfully.
Jul 28 00:27:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Attempting a stable device rescue
Jul 28 00:27:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70709) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 28 00:27:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Instance directory exists: not creating {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 28 00:27:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Creating image(s)
Jul 28 00:27:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "/opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "/opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:52 user nova-compute[70709]: DEBUG nova.objects.instance [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "401c34d740ce477f8426b9e3eb8e9919c1ddb5bb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "401c34d740ce477f8426b9e3eb8e9919c1ddb5bb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb.part --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb.part --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG nova.virt.images [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] b57b448b-ed28-4680-a972-6f589f577182 was qcow2, converting to raw {{(pid=70709) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb.part /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb.converted {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb.part /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb.converted" returned: 0 in 0.203s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG nova.compute.manager [req-38da9d2a-77ad-4b0b-9acd-c0c58301a3c3 req-30982fe6-9fc0-4a4d-901f-ae66bf609244 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-38da9d2a-77ad-4b0b-9acd-c0c58301a3c3 req-30982fe6-9fc0-4a4d-901f-ae66bf609244 service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-38da9d2a-77ad-4b0b-9acd-c0c58301a3c3 req-30982fe6-9fc0-4a4d-901f-ae66bf609244 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-38da9d2a-77ad-4b0b-9acd-c0c58301a3c3 req-30982fe6-9fc0-4a4d-901f-ae66bf609244 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG nova.compute.manager [req-38da9d2a-77ad-4b0b-9acd-c0c58301a3c3 req-30982fe6-9fc0-4a4d-901f-ae66bf609244 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:53 user nova-compute[70709]: WARNING nova.compute.manager [req-38da9d2a-77ad-4b0b-9acd-c0c58301a3c3 req-30982fe6-9fc0-4a4d-901f-ae66bf609244 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received unexpected event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with vm_state active and task_state rescuing.
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb.converted --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb.converted --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "401c34d740ce477f8426b9e3eb8e9919c1ddb5bb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.705s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "401c34d740ce477f8426b9e3eb8e9919c1ddb5bb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "401c34d740ce477f8426b9e3eb8e9919c1ddb5bb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb --force-share --output=json" returned: 0 in 0.170s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb,backing_fmt=raw /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.rescue {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb,backing_fmt=raw /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.rescue" returned: 0 in 0.047s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "401c34d740ce477f8426b9e3eb8e9919c1ddb5bb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.objects.instance [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'migration_context' on Instance uuid 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Start _get_guest_xml network_info=[{"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "vif_mac": "fa:16:3e:8a:25:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b57b448b-ed28-4680-a972-6f589f577182', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'bea8b248-0c60-4383-a1a5-57d97c5b3a0e', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'compYVDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '7f93835f-ae7f-430b-b30b-33a82ae6e2a2', 'attached_at': '', 'detached_at': '', 'volume_id': '143be64f-f3a7-4b09-a61a-f6b0b30c7f57', 'serial': '143be64f-f3a7-4b09-a61a-f6b0b30c7f57'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.objects.instance [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'resources' on Instance uuid 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.objects.instance [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'numa_topology' on Instance uuid 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:54 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:27:54 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.objects.instance [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'compYVDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:27:54 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:27:54 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:27:54 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b9a94b-1cfe-4f70-8d88-2b52e83168f0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = compYVDC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 28 00:27:54 user nova-compute[70709]: node.name = iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57
Jul 28 00:27:54 user nova-compute[70709]: node.tpgt = -1
Jul 28 00:27:54 user nova-compute[70709]: node.startup = automatic
Jul 28 00:27:54 user nova-compute[70709]: node.leading_login = No
Jul 28 00:27:54 user nova-compute[70709]: iface.iscsi_ifacename = default
Jul 28 00:27:54 user nova-compute[70709]: iface.net_ifacename = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.ipaddress = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.prefix_len = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.hwaddress = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.transport_name = tcp
Jul 28 00:27:54 user nova-compute[70709]: iface.initiatorname = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.state = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.vlan_id = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.vlan_priority = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.vlan_state = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.iface_num = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.mtu = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.port = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.bootproto = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.subnet_mask = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.gateway = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.dhcp_alt_client_id_state = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.dhcp_alt_client_id = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.dhcp_dns = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.dhcp_learn_iqn = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.dhcp_req_vendor_id_state = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.dhcp_vendor_id_state = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.dhcp_vendor_id = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.dhcp_slp_da = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.fragmentation = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.gratuitous_arp = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.incoming_forwarding = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.tos_state = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.tos = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.ttl = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.delayed_ack = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.tcp_nagle = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.tcp_wsf_state = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.tcp_wsf = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.tcp_timer_scale = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.tcp_timestamp = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.redirect = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.def_task_mgmt_timeout = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.header_digest = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.data_digest = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.immediate_data = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.initial_r2t = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.data_seq_inorder = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.data_pdu_inorder = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.erl = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.max_receive_data_len = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.first_burst_len = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.max_outstanding_r2t = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.max_burst_len = 0
Jul 28 00:27:54 user nova-compute[70709]: iface.chap_auth = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.bidi_chap = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.strict_login_compliance = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.discovery_auth = <empty>
Jul 28 00:27:54 user nova-compute[70709]: iface.discovery_logout = <empty>
Jul 28 00:27:54 user nova-compute[70709]: node.discovery_address = <empty>
Jul 28 00:27:54 user nova-compute[70709]: node.discovery_port = 0
Jul 28 00:27:54 user nova-compute[70709]: node.discovery_type = static
Jul 28 00:27:54 user nova-compute[70709]: node.session.initial_cmdsn = 0
Jul 28 00:27:54 user nova-compute[70709]: node.session.initial_login_retry_max = 8
Jul 28 00:27:54 user nova-compute[70709]: node.session.xmit_thread_priority = -20
Jul 28 00:27:54 user nova-compute[70709]: node.session.cmds_max = 128
Jul 28 00:27:54 user nova-compute[70709]: node.session.queue_depth = 32
Jul 28 00:27:54 user nova-compute[70709]: node.session.nr_sessions = 1
Jul 28 00:27:54 user nova-compute[70709]: node.session.auth.authmethod = CHAP
Jul 28 00:27:54 user nova-compute[70709]: node.session.auth.username = compYVDC
Jul 28 00:27:54 user nova-compute[70709]: node.session.auth.password = ***
Jul 28 00:27:54 user nova-compute[70709]: node.session.auth.username_in = <empty>
Jul 28 00:27:54 user nova-compute[70709]: node.session.auth.password_in = <empty>
Jul 28 00:27:54 user nova-compute[70709]: node.session.auth.chap_algs = MD5
Jul 28 00:27:54 user nova-compute[70709]: node.session.timeo.replacement_timeout = 120
Jul 28 00:27:54 user nova-compute[70709]: node.session.err_timeo.abort_timeout = 15
Jul 28 00:27:54 user nova-compute[70709]: node.session.err_timeo.lu_reset_timeout = 30
Jul 28 00:27:54 user nova-compute[70709]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 28 00:27:54 user nova-compute[70709]: node.session.err_timeo.host_reset_timeout = 60
Jul 28 00:27:54 user nova-compute[70709]: node.session.iscsi.FastAbort = Yes
Jul 28 00:27:54 user nova-compute[70709]: node.session.iscsi.InitialR2T = No
Jul 28 00:27:54 user nova-compute[70709]: node.session.iscsi.ImmediateData = Yes
Jul 28 00:27:54 user nova-compute[70709]: node.session.iscsi.FirstBurstLength = 262144
Jul 28 00:27:54 user nova-compute[70709]: node.session.iscsi.MaxBurstLength = 16776192
Jul 28 00:27:54 user nova-compute[70709]: node.session.iscsi.DefaultTime2Retain = 0
Jul 28 00:27:54 user nova-compute[70709]: node.session.iscsi.DefaultTime2Wait = 2
Jul 28 00:27:54 user nova-compute[70709]: node.session.iscsi.MaxConnections = 1
Jul 28 00:27:54 user nova-compute[70709]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 28 00:27:54 user nova-compute[70709]: node.session.iscsi.ERL = 0
Jul 28 00:27:54 user nova-compute[70709]: node.session.scan = manual
Jul 28 00:27:54 user nova-compute[70709]: node.session.reopen_max = 0
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].address = 172.16.0.220
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].port = 3260
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].startup = manual
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].tcp.window_size = 524288
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].tcp.type_of_service = 0
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].timeo.logout_timeout = 15
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].timeo.login_timeout = 15
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].timeo.auth_timeout = 45
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].timeo.noop_out_interval = 5
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].timeo.noop_out_timeout = 5
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].iscsi.HeaderDigest = None
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].iscsi.DataDigest = None
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].iscsi.IFMarker = No
Jul 28 00:27:54 user nova-compute[70709]: node.conn[0].iscsi.OFMarker = No
Jul 28 00:27:54 user nova-compute[70709]: # END RECORD
Jul 28 00:27:54 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead33a6b-6f12-44da-b927-b4e82042fb05]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[26325e9f-02cf-4b17-9b98-090ba1a95f80]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v compYVDC {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v compYVDC" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd507806-faed-4b6f-a0df-3e278b0561ba]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'compYVDC'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0417e9-5071-41a6-9499-0a79168bfce6]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4562801b-c4d8-4cf3-b531-0d69ba5e9e6a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:54 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:54 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:54 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:54 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:54 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:54 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] HCTL ('35', '0', '0', 0) found on session 35 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa78f8e0-5864-4f41-860f-c1a3b71c8e06]: (4, ('0 0 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Searching for a device in session 35 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'compYVDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '23965376433663465', 'path': '/dev/sdd'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965376433663465', 'path': '/dev/sdd'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-547250233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-547250233',id=30,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:26:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-fhh06lyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:26:22Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=7f93835f-ae7f-430b-b30b-33a82ae6e2a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "vif_mac": "fa:16:3e:8a:25:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "vif_mac": "fa:16:3e:8a:25:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:25:5c,bridge_name='br-int',has_traffic_filtering=True,id=24b5fc91-8612-423c-a94a-5759d0ad3cb2,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b5fc91-86') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.objects.instance [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:27:54 user nova-compute[70709]:   <uuid>7f93835f-ae7f-430b-b30b-33a82ae6e2a2</uuid>
Jul 28 00:27:54 user nova-compute[70709]:   <name>instance-0000001e</name>
Jul 28 00:27:54 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:27:54 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:27:54 user nova-compute[70709]:   <metadata>
Jul 28 00:27:54 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:27:54 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:27:54 user nova-compute[70709]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-547250233</nova:name>
Jul 28 00:27:54 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:27:54</nova:creationTime>
Jul 28 00:27:54 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:27:54 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:27:54 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:27:54 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:27:54 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:27:54 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:27:54 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:27:54 user nova-compute[70709]:       <nova:owner>
Jul 28 00:27:54 user nova-compute[70709]:         <nova:user uuid="fa22ce59fc4742d4ab16292a8b3d6e3f">tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member</nova:user>
Jul 28 00:27:54 user nova-compute[70709]:         <nova:project uuid="6929fa5cb2284dd8b94c387bf6e3fef6">tempest-ServerBootFromVolumeStableRescueTest-2075329923</nova:project>
Jul 28 00:27:54 user nova-compute[70709]:       </nova:owner>
Jul 28 00:27:54 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:27:54 user nova-compute[70709]:       <nova:ports>
Jul 28 00:27:54 user nova-compute[70709]:         <nova:port uuid="24b5fc91-8612-423c-a94a-5759d0ad3cb2">
Jul 28 00:27:54 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 28 00:27:54 user nova-compute[70709]:         </nova:port>
Jul 28 00:27:54 user nova-compute[70709]:       </nova:ports>
Jul 28 00:27:54 user nova-compute[70709]:     </nova:instance>
Jul 28 00:27:54 user nova-compute[70709]:   </metadata>
Jul 28 00:27:54 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:27:54 user nova-compute[70709]:     <system>
Jul 28 00:27:54 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:27:54 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:27:54 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:27:54 user nova-compute[70709]:       <entry name="serial">7f93835f-ae7f-430b-b30b-33a82ae6e2a2</entry>
Jul 28 00:27:54 user nova-compute[70709]:       <entry name="uuid">7f93835f-ae7f-430b-b30b-33a82ae6e2a2</entry>
Jul 28 00:27:54 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:27:54 user nova-compute[70709]:     </system>
Jul 28 00:27:54 user nova-compute[70709]:   </sysinfo>
Jul 28 00:27:54 user nova-compute[70709]:   <os>
Jul 28 00:27:54 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:27:54 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:27:54 user nova-compute[70709]:   </os>
Jul 28 00:27:54 user nova-compute[70709]:   <features>
Jul 28 00:27:54 user nova-compute[70709]:     <acpi/>
Jul 28 00:27:54 user nova-compute[70709]:     <apic/>
Jul 28 00:27:54 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:27:54 user nova-compute[70709]:   </features>
Jul 28 00:27:54 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:27:54 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:27:54 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:27:54 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:27:54 user nova-compute[70709]:   </clock>
Jul 28 00:27:54 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:27:54 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:27:54 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:27:54 user nova-compute[70709]:   </cpu>
Jul 28 00:27:54 user nova-compute[70709]:   <devices>
Jul 28 00:27:54 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:27:54 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:27:54 user nova-compute[70709]:       <source dev="/dev/sdd"/>
Jul 28 00:27:54 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:27:54 user nova-compute[70709]:       <serial>143be64f-f3a7-4b09-a61a-f6b0b30c7f57</serial>
Jul 28 00:27:54 user nova-compute[70709]:     </disk>
Jul 28 00:27:54 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:27:54 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:27:54 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.rescue"/>
Jul 28 00:27:54 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:27:54 user nova-compute[70709]:       <boot order="1"/>
Jul 28 00:27:54 user nova-compute[70709]:     </disk>
Jul 28 00:27:54 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:27:54 user nova-compute[70709]:       <mac address="fa:16:3e:8a:25:5c"/>
Jul 28 00:27:54 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:27:54 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:27:54 user nova-compute[70709]:       <target dev="tap24b5fc91-86"/>
Jul 28 00:27:54 user nova-compute[70709]:     </interface>
Jul 28 00:27:54 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:27:54 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/console.log" append="off"/>
Jul 28 00:27:54 user nova-compute[70709]:     </serial>
Jul 28 00:27:54 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:27:54 user nova-compute[70709]:     <video>
Jul 28 00:27:54 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:27:54 user nova-compute[70709]:     </video>
Jul 28 00:27:54 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:27:54 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:27:54 user nova-compute[70709]:     </rng>
Jul 28 00:27:54 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:27:54 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:27:54 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:27:54 user nova-compute[70709]:     </memballoon>
Jul 28 00:27:54 user nova-compute[70709]:   </devices>
Jul 28 00:27:54 user nova-compute[70709]: </domain>
Jul 28 00:27:54 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:27:54 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Instance destroyed successfully.
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:27:54 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] No VIF found with MAC fa:16:3e:8a:25:5c, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:27:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-e8149bb3-cd7f-4923-b668-d82b82c3191a req-8f31a893-227c-4962-8fa0-c36f9144d583 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-changed-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-e8149bb3-cd7f-4923-b668-d82b82c3191a req-8f31a893-227c-4962-8fa0-c36f9144d583 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Refreshing instance network info cache due to event network-changed-04d723ad-66a0-49a0-af57-cb899673cc7b. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e8149bb3-cd7f-4923-b668-d82b82c3191a req-8f31a893-227c-4962-8fa0-c36f9144d583 service nova] Acquiring lock "refresh_cache-f468456b-a0e5-4b79-a88d-a2303ce5920b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e8149bb3-cd7f-4923-b668-d82b82c3191a req-8f31a893-227c-4962-8fa0-c36f9144d583 service nova] Acquired lock "refresh_cache-f468456b-a0e5-4b79-a88d-a2303ce5920b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG nova.network.neutron [req-e8149bb3-cd7f-4923-b668-d82b82c3191a req-8f31a893-227c-4962-8fa0-c36f9144d583 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Refreshing network info cache for port 04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-4e1e38d3-1c4f-4133-8d17-fe59f533b3ef req-65d7d1a7-1725-4984-9b73-0d915223e25b service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4e1e38d3-1c4f-4133-8d17-fe59f533b3ef req-65d7d1a7-1725-4984-9b73-0d915223e25b service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4e1e38d3-1c4f-4133-8d17-fe59f533b3ef req-65d7d1a7-1725-4984-9b73-0d915223e25b service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4e1e38d3-1c4f-4133-8d17-fe59f533b3ef req-65d7d1a7-1725-4984-9b73-0d915223e25b service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-4e1e38d3-1c4f-4133-8d17-fe59f533b3ef req-65d7d1a7-1725-4984-9b73-0d915223e25b service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:56 user nova-compute[70709]: WARNING nova.compute.manager [req-4e1e38d3-1c4f-4133-8d17-fe59f533b3ef req-65d7d1a7-1725-4984-9b73-0d915223e25b service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received unexpected event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with vm_state active and task_state rescuing.
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG nova.objects.instance [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'flavor' on Instance uuid f468456b-a0e5-4b79-a88d-a2303ce5920b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:56 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Ignoring supplied device name: /dev/vdb
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:56 user nova-compute[70709]: INFO nova.compute.manager [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Attaching volume bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 to /dev/vdb
Jul 28 00:27:56 user nova-compute[70709]: DEBUG os_brick.utils [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e2eb7f-caef-46a4-87bb-e886eb71edbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG nova.network.neutron [req-e8149bb3-cd7f-4923-b668-d82b82c3191a req-8f31a893-227c-4962-8fa0-c36f9144d583 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Updated VIF entry in instance network info cache for port 04d723ad-66a0-49a0-af57-cb899673cc7b. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG nova.network.neutron [req-e8149bb3-cd7f-4923-b668-d82b82c3191a req-8f31a893-227c-4962-8fa0-c36f9144d583 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Updating instance_info_cache with network_info: [{"id": "04d723ad-66a0-49a0-af57-cb899673cc7b", "address": "fa:16:3e:55:de:9c", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d723ad-66", "ovs_interfaceid": "04d723ad-66a0-49a0-af57-cb899673cc7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e8149bb3-cd7f-4923-b668-d82b82c3191a req-8f31a893-227c-4962-8fa0-c36f9144d583 service nova] Releasing lock "refresh_cache-f468456b-a0e5-4b79-a88d-a2303ce5920b" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce80645d-cee4-4ddc-b1f1-7288d0b54847]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abde0f6-fabe-4ff6-9c1a-25578e698123]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d83ff93-f2b7-4e28-baff-de2343d8b0bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:27:56 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:27:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f58d65-7145-4f56-ab86-0dce326636db]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG os_brick.utils [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:27:56 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Updating existing volume attachment record: c1106d5e-e305-4f79-8af9-cd1f21063a3f {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "5fbef78b-fc10-46c8-8762-5471ca191316" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:57 user nova-compute[70709]: INFO nova.compute.manager [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Terminating instance
Jul 28 00:27:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDYNMxZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:27:57 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:27:57 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:27:57 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1178fff-f898-4984-82f0-f8a8965656f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:27:57 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f3adf1-f3e8-43fb-ab0a-fe03d7fca4bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4] added
Jul 28 00:27:57 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[570258ea-8bfe-4230-98da-c62bb4d0b92b]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7677613d-445b-4ff2-9ec5-f97edc24e657]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iDYNMxZV {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iDYNMxZV" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e1329f-a015-4e88-a8ef-2f92e07c7e31]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iDYNMxZV'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b07411b-8e8b-4b2f-a4da-23cfec6dcb39]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d080006-13d8-46d7-a71c-523da41e2bfd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:57 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:57 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:57 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:57 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:57 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:57 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:57 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bdccde-3bdd-4868-a68c-16bc5cfbc61d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4, portal: 172.16.0.220,3260]
Jul 28 00:27:58 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4, portal: 172.16.0.220,3260] successful.
Jul 28 00:27:58 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ebdb13-e5ee-45aa-b72e-6e60c0311ca9]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-ddea886e-8902-4b52-acd3-01fd093f613e req-6012ab80-2a00-4769-b0e3-09f3a4a900fa service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Received event network-vif-unplugged-898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ddea886e-8902-4b52-acd3-01fd093f613e req-6012ab80-2a00-4769-b0e3-09f3a4a900fa service nova] Acquiring lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ddea886e-8902-4b52-acd3-01fd093f613e req-6012ab80-2a00-4769-b0e3-09f3a4a900fa service nova] Lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ddea886e-8902-4b52-acd3-01fd093f613e req-6012ab80-2a00-4769-b0e3-09f3a4a900fa service nova] Lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-ddea886e-8902-4b52-acd3-01fd093f613e req-6012ab80-2a00-4769-b0e3-09f3a4a900fa service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] No waiting events found dispatching network-vif-unplugged-898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-ddea886e-8902-4b52-acd3-01fd093f613e req-6012ab80-2a00-4769-b0e3-09f3a4a900fa service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Received event network-vif-unplugged-898f0691-1e6e-4a2e-a165-5a9f10387dda for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:27:58 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Instance destroyed successfully.
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lazy-loading 'resources' on Instance uuid 5fbef78b-fc10-46c8-8762-5471ca191316 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4b9053-9168-4eb1-b850-6417f8a9cbac]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:58 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:58 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:58 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:27:58 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:27:58 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:27:58 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:27:58 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:27:58 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-498505944',display_name='tempest-AttachVolumeNegativeTest-server-498505944',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-498505944',id=27,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxhkSYpSn1r9Xi8FNXPqyZLYmmPEztiVBGgT/LPbnfjdqVo7LNRS8PFFocNCvbJggKA0lP9Ao9RkDjUxu/8pgPTuB6QJJs/4IELpewuVoCqJFs+ndceGY4vJ7KD0hFbYQ==',key_name='tempest-keypair-1552314378',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e05b559855734f9e9b221ec954881ccd',ramdisk_id='',reservation_id='r-zyjb6tpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-337281402',owner_user_name='tempest-AttachVolumeNegativeTest-337281402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:25:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8557f7232a94f76982b8840c534a6d4',uuid=5fbef78b-fc10-46c8-8762-5471ca191316,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "address": "fa:16:3e:f2:3a:3e", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898f0691-1e", "ovs_interfaceid": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converting VIF {"id": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "address": "fa:16:3e:f2:3a:3e", "network": {"id": "257469ea-5798-468d-8447-4bb6f1921f40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-294154433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e05b559855734f9e9b221ec954881ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898f0691-1e", "ovs_interfaceid": "898f0691-1e6e-4a2e-a165-5a9f10387dda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:3a:3e,bridge_name='br-int',has_traffic_filtering=True,id=898f0691-1e6e-4a2e-a165-5a9f10387dda,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898f0691-1e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG os_vif [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:3a:3e,bridge_name='br-int',has_traffic_filtering=True,id=898f0691-1e6e-4a2e-a165-5a9f10387dda,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898f0691-1e') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap898f0691-1e, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[718c2a5e-f85c-4035-baf5-824aa73b0e86]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDYNMxZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:27:58 user nova-compute[70709]: INFO os_vif [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:3a:3e,bridge_name='br-int',has_traffic_filtering=True,id=898f0691-1e6e-4a2e-a165-5a9f10387dda,network=Network(257469ea-5798-468d-8447-4bb6f1921f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898f0691-1e')
Jul 28 00:27:58 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Deleting instance files /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316_del
Jul 28 00:27:58 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Deletion of /opt/stack/data/nova/instances/5fbef78b-fc10-46c8-8762-5471ca191316_del complete
Jul 28 00:27:58 user nova-compute[70709]: INFO nova.compute.manager [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-ad46a022-c043-410c-96f4-9ca08f47a469 req-467c0d85-855f-4d37-a639-7ce544374a69 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ad46a022-c043-410c-96f4-9ca08f47a469 req-467c0d85-855f-4d37-a639-7ce544374a69 service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ad46a022-c043-410c-96f4-9ca08f47a469 req-467c0d85-855f-4d37-a639-7ce544374a69 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ad46a022-c043-410c-96f4-9ca08f47a469 req-467c0d85-855f-4d37-a639-7ce544374a69 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-ad46a022-c043-410c-96f4-9ca08f47a469 req-467c0d85-855f-4d37-a639-7ce544374a69 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:27:58 user nova-compute[70709]: WARNING nova.compute.manager [req-ad46a022-c043-410c-96f4-9ca08f47a469 req-467c0d85-855f-4d37-a639-7ce544374a69 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received unexpected event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with vm_state active and task_state rescuing.
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504078.3530693, 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:27:58 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] VM Resumed (Lifecycle Event)
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-171acf7e-067d-43d6-95c9-4b22376d14f0 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:27:58 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504078.3550212, 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:27:58 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] VM Started (Lifecycle Event)
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:27:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23464666166613631', 'path': '/dev/sde'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464666166613631', 'path': '/dev/sde'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG nova.objects.instance [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'flavor' on Instance uuid 560f0547-6eb6-4009-87ba-8206a77c27e8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:27:59 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:27:59 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:27:59 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:27:59 user nova-compute[70709]:   <serial>94d4109b-f33a-4d07-9581-1e35034847d4</serial>
Jul 28 00:27:59 user nova-compute[70709]: </disk>
Jul 28 00:27:59 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:27:59 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Took 1.08 seconds to deallocate network for instance.
Jul 28 00:27:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] No VIF found with MAC fa:16:3e:1e:53:55, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-71997e0a-e766-4c48-b253-2150e26d9be6 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.062s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:27:59 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Deleted allocations for instance 5fbef78b-fc10-46c8-8762-5471ca191316
Jul 28 00:28:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61515d5-e3cf-4934-885a-8ce691d04f71 tempest-AttachVolumeNegativeTest-337281402 tempest-AttachVolumeNegativeTest-337281402-project-member] Lock "5fbef78b-fc10-46c8-8762-5471ca191316" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.738s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-7e5ca78a-d171-494d-8cca-111f6322847e req-908fa743-a545-47a6-9d6b-74dfa8d7f69e service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Received event network-vif-plugged-898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7e5ca78a-d171-494d-8cca-111f6322847e req-908fa743-a545-47a6-9d6b-74dfa8d7f69e service nova] Acquiring lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7e5ca78a-d171-494d-8cca-111f6322847e req-908fa743-a545-47a6-9d6b-74dfa8d7f69e service nova] Lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7e5ca78a-d171-494d-8cca-111f6322847e req-908fa743-a545-47a6-9d6b-74dfa8d7f69e service nova] Lock "5fbef78b-fc10-46c8-8762-5471ca191316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-7e5ca78a-d171-494d-8cca-111f6322847e req-908fa743-a545-47a6-9d6b-74dfa8d7f69e service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] No waiting events found dispatching network-vif-plugged-898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:00 user nova-compute[70709]: WARNING nova.compute.manager [req-7e5ca78a-d171-494d-8cca-111f6322847e req-908fa743-a545-47a6-9d6b-74dfa8d7f69e service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Received unexpected event network-vif-plugged-898f0691-1e6e-4a2e-a165-5a9f10387dda for instance with vm_state deleted and task_state None.
Jul 28 00:28:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-dfc036ff-aba8-47d5-b7fe-8e1fac0e4984 req-e336a428-2977-49af-9ab8-6eb92e899673 service nova] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Received event network-vif-deleted-898f0691-1e6e-4a2e-a165-5a9f10387dda {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:02 user nova-compute[70709]: INFO nova.compute.manager [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Terminating instance
Jul 28 00:28:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:28:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-4a502198-d621-4d1a-90cb-73799ba614ba req-f248db30-510a-49ae-b022-7b4a01785a12 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Received event network-vif-unplugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4a502198-d621-4d1a-90cb-73799ba614ba req-f248db30-510a-49ae-b022-7b4a01785a12 service nova] Acquiring lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4a502198-d621-4d1a-90cb-73799ba614ba req-f248db30-510a-49ae-b022-7b4a01785a12 service nova] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4a502198-d621-4d1a-90cb-73799ba614ba req-f248db30-510a-49ae-b022-7b4a01785a12 service nova] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-4a502198-d621-4d1a-90cb-73799ba614ba req-f248db30-510a-49ae-b022-7b4a01785a12 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] No waiting events found dispatching network-vif-unplugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-4a502198-d621-4d1a-90cb-73799ba614ba req-f248db30-510a-49ae-b022-7b4a01785a12 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Received event network-vif-unplugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:28:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Instance destroyed successfully.
Jul 28 00:28:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lazy-loading 'resources' on Instance uuid a8f0e31a-8842-4c6e-b7a2-0e733216cce1 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1598606518',display_name='tempest-ServersNegativeTestJSON-server-1598606518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1598606518',id=32,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:26:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c96d74828e1479381106c4c6538ea78',ramdisk_id='',reservation_id='r-f349n7f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-969661376',owner_user_name='tempest-ServersNegativeTestJSON-969661376-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:26:22Z,user_data=None,user_id='3328a16a9f1f4311899b091ce8412ba5',uuid=a8f0e31a-8842-4c6e-b7a2-0e733216cce1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "address": "fa:16:3e:e5:3a:a2", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50a6f65-91", "ovs_interfaceid": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converting VIF {"id": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "address": "fa:16:3e:e5:3a:a2", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50a6f65-91", "ovs_interfaceid": "c50a6f65-91d2-47b6-a27c-9b3e39a96952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=c50a6f65-91d2-47b6-a27c-9b3e39a96952,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50a6f65-91') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG os_vif [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=c50a6f65-91d2-47b6-a27c-9b3e39a96952,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50a6f65-91') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc50a6f65-91, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:28:03 user nova-compute[70709]: INFO os_vif [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=c50a6f65-91d2-47b6-a27c-9b3e39a96952,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50a6f65-91')
Jul 28 00:28:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Deleting instance files /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1_del
Jul 28 00:28:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Deletion of /opt/stack/data/nova/instances/a8f0e31a-8842-4c6e-b7a2-0e733216cce1_del complete
Jul 28 00:28:03 user nova-compute[70709]: INFO nova.compute.manager [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 28 00:28:03 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:28:03 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-4eeaf522-96e4-48e6-be42-0e9f064ccb2e req-f9e21d01-b85e-44e3-b462-a370d4c6c39c service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-changed-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-4eeaf522-96e4-48e6-be42-0e9f064ccb2e req-f9e21d01-b85e-44e3-b462-a370d4c6c39c service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Refreshing instance network info cache due to event network-changed-e3bd2d01-d61d-4d30-a088-13f85c724ce1. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4eeaf522-96e4-48e6-be42-0e9f064ccb2e req-f9e21d01-b85e-44e3-b462-a370d4c6c39c service nova] Acquiring lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4eeaf522-96e4-48e6-be42-0e9f064ccb2e req-f9e21d01-b85e-44e3-b462-a370d4c6c39c service nova] Acquired lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-4eeaf522-96e4-48e6-be42-0e9f064ccb2e req-f9e21d01-b85e-44e3-b462-a370d4c6c39c service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Refreshing network info cache for port e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-270eef9f-8e96-49c8-aa54-5a04fa578641 req-e3fa4e06-3e03-476a-ab1b-6c9a1875ee7f service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Received event network-vif-deleted-c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:04 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Took 0.84 seconds to deallocate network for instance.
Jul 28 00:28:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-4eeaf522-96e4-48e6-be42-0e9f064ccb2e req-f9e21d01-b85e-44e3-b462-a370d4c6c39c service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updated VIF entry in instance network info cache for port e3bd2d01-d61d-4d30-a088-13f85c724ce1. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-4eeaf522-96e4-48e6-be42-0e9f064ccb2e req-f9e21d01-b85e-44e3-b462-a370d4c6c39c service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updating instance_info_cache with network_info: [{"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4eeaf522-96e4-48e6-be42-0e9f064ccb2e req-f9e21d01-b85e-44e3-b462-a370d4c6c39c service nova] Releasing lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:28:04 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:05 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Deleted allocations for instance a8f0e31a-8842-4c6e-b7a2-0e733216cce1
Jul 28 00:28:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEneykiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:28:05 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:28:05 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:28:05 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7031aec9-daa2-4472-97c9-5cf84857f2cc tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.459s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a18f08-730f-440c-98e9-3e4bd9c04d7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:28:05 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[77131ef3-9ad5-4cce-aebe-83526de9bc55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0] added
Jul 28 00:28:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7826e9-3973-4a03-b977-8cc89eb9378c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-a3c6772f-4095-4206-910a-25e859a36d8f req-44cf77c7-56ff-45c2-a0c6-35ed3241d179 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Received event network-vif-plugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a3c6772f-4095-4206-910a-25e859a36d8f req-44cf77c7-56ff-45c2-a0c6-35ed3241d179 service nova] Acquiring lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a3c6772f-4095-4206-910a-25e859a36d8f req-44cf77c7-56ff-45c2-a0c6-35ed3241d179 service nova] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a3c6772f-4095-4206-910a-25e859a36d8f req-44cf77c7-56ff-45c2-a0c6-35ed3241d179 service nova] Lock "a8f0e31a-8842-4c6e-b7a2-0e733216cce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-a3c6772f-4095-4206-910a-25e859a36d8f req-44cf77c7-56ff-45c2-a0c6-35ed3241d179 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] No waiting events found dispatching network-vif-plugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:05 user nova-compute[70709]: WARNING nova.compute.manager [req-a3c6772f-4095-4206-910a-25e859a36d8f req-44cf77c7-56ff-45c2-a0c6-35ed3241d179 service nova] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Received unexpected event network-vif-plugged-c50a6f65-91d2-47b6-a27c-9b3e39a96952 for instance with vm_state deleted and task_state None.
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c817818c-38f7-4a30-9202-fd0b36ff7031]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEneykiD {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEneykiD" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[21322608-a85a-479c-9dbc-bf64b5a0da95]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sEneykiD'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19cee67-a9fd-44a7-b8d4-9f1dd2b2dba7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c29daee-1029-48a7-b430-a7c6eec253ba]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[681f6270-e0e6-45c9-926a-e46535611994]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0, portal: 172.16.0.220,3260]
Jul 28 00:28:05 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0, portal: 172.16.0.220,3260] successful.
Jul 28 00:28:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f84c9d0-5ff8-4062-85d8-3475275ae049]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a6b7ab-1451-4263-a596-e35083ab8957]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 (non-flash)
Jul 28 00:28:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f0a768-2315-42d9-a47c-9e1e852c511d]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:05 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:28:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:28:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEneykiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:28:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:28:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23832373139383865', 'path': '/dev/sdf'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:28:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832373139383865', 'path': '/dev/sdf'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:28:06 user nova-compute[70709]: DEBUG nova.objects.instance [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'flavor' on Instance uuid f468456b-a0e5-4b79-a88d-a2303ce5920b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:28:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:28:06 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:28:06 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:28:06 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:28:06 user nova-compute[70709]:   <serial>bcd8b818-8ffa-4a00-b05b-15a3c29c16b0</serial>
Jul 28 00:28:06 user nova-compute[70709]: </disk>
Jul 28 00:28:06 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] No VIF found with MAC fa:16:3e:55:de:9c, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d0f06c68-b1a6-42ba-b7f8-0e6d68376df2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.553s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:07 user nova-compute[70709]: INFO nova.compute.manager [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Rebooting instance
Jul 28 00:28:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquired lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-abf069a8-9204-4e90-98fd-f43e23c299dc req-9361efcc-ca2e-4c82-9a6c-2cb2723def44 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-changed-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-abf069a8-9204-4e90-98fd-f43e23c299dc req-9361efcc-ca2e-4c82-9a6c-2cb2723def44 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Refreshing instance network info cache due to event network-changed-e3bd2d01-d61d-4d30-a088-13f85c724ce1. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-abf069a8-9204-4e90-98fd-f43e23c299dc req-9361efcc-ca2e-4c82-9a6c-2cb2723def44 service nova] Acquiring lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updating instance_info_cache with network_info: [{"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Releasing lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-abf069a8-9204-4e90-98fd-f43e23c299dc req-9361efcc-ca2e-4c82-9a6c-2cb2723def44 service nova] Acquired lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG nova.network.neutron [req-abf069a8-9204-4e90-98fd-f43e23c299dc req-9361efcc-ca2e-4c82-9a6c-2cb2723def44 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Refreshing network info cache for port e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:28:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:28:08 user nova-compute[70709]: DEBUG nova.network.neutron [req-abf069a8-9204-4e90-98fd-f43e23c299dc req-9361efcc-ca2e-4c82-9a6c-2cb2723def44 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updated VIF entry in instance network info cache for port e3bd2d01-d61d-4d30-a088-13f85c724ce1. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:28:08 user nova-compute[70709]: DEBUG nova.network.neutron [req-abf069a8-9204-4e90-98fd-f43e23c299dc req-9361efcc-ca2e-4c82-9a6c-2cb2723def44 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updating instance_info_cache with network_info: [{"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:28:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-abf069a8-9204-4e90-98fd-f43e23c299dc req-9361efcc-ca2e-4c82-9a6c-2cb2723def44 service nova] Releasing lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:28:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-87777cf8-4072-482b-9692-484821350b00 req-b981c1bc-5a7d-4dc3-beb1-cfec10f97144 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-vif-unplugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-87777cf8-4072-482b-9692-484821350b00 req-b981c1bc-5a7d-4dc3-beb1-cfec10f97144 service nova] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-87777cf8-4072-482b-9692-484821350b00 req-b981c1bc-5a7d-4dc3-beb1-cfec10f97144 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-87777cf8-4072-482b-9692-484821350b00 req-b981c1bc-5a7d-4dc3-beb1-cfec10f97144 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-87777cf8-4072-482b-9692-484821350b00 req-b981c1bc-5a7d-4dc3-beb1-cfec10f97144 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] No waiting events found dispatching network-vif-unplugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:10 user nova-compute[70709]: WARNING nova.compute.manager [req-87777cf8-4072-482b-9692-484821350b00 req-b981c1bc-5a7d-4dc3-beb1-cfec10f97144 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received unexpected event network-vif-unplugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 for instance with vm_state active and task_state reboot_started.
Jul 28 00:28:10 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Instance shutdown successfully.
Jul 28 00:28:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-4b417f8b-aea0-4c42-9f12-8d1755cae5c2 req-9f20a10d-11e5-432e-9a46-a42124ff1c17 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4b417f8b-aea0-4c42-9f12-8d1755cae5c2 req-9f20a10d-11e5-432e-9a46-a42124ff1c17 service nova] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4b417f8b-aea0-4c42-9f12-8d1755cae5c2 req-9f20a10d-11e5-432e-9a46-a42124ff1c17 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4b417f8b-aea0-4c42-9f12-8d1755cae5c2 req-9f20a10d-11e5-432e-9a46-a42124ff1c17 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:12 user nova-compute[70709]: DEBUG nova.compute.manager [req-4b417f8b-aea0-4c42-9f12-8d1755cae5c2 req-9f20a10d-11e5-432e-9a46-a42124ff1c17 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] No waiting events found dispatching network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:12 user nova-compute[70709]: WARNING nova.compute.manager [req-4b417f8b-aea0-4c42-9f12-8d1755cae5c2 req-9f20a10d-11e5-432e-9a46-a42124ff1c17 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received unexpected event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 for instance with vm_state active and task_state reboot_started.
Jul 28 00:28:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:13 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504078.1344318, 5fbef78b-fc10-46c8-8762-5471ca191316 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:28:13 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] VM Stopped (Lifecycle Event)
Jul 28 00:28:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-80b26475-32ca-48dc-8d11-79fcd2a4a2c2 None None] [instance: 5fbef78b-fc10-46c8-8762-5471ca191316] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:28:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] No waiting events found dispatching network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:14 user nova-compute[70709]: WARNING nova.compute.manager [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received unexpected event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 for instance with vm_state active and task_state reboot_started.
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] No waiting events found dispatching network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:14 user nova-compute[70709]: WARNING nova.compute.manager [req-04e03ae4-9192-4024-a974-0cac0d0d621c req-78a0b04a-75ac-40c2-8632-c2f11dde81e9 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received unexpected event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 for instance with vm_state active and task_state reboot_started.
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for 560f0547-6eb6-4009-87ba-8206a77c27e8 due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504094.6105826, 560f0547-6eb6-4009-87ba-8206a77c27e8 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:28:14 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] VM Resumed (Lifecycle Event)
Jul 28 00:28:14 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Instance running successfully.
Jul 28 00:28:14 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Instance soft rebooted successfully.
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:28:14 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504094.6127017, 560f0547-6eb6-4009-87ba-8206a77c27e8 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:28:14 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] VM Started (Lifecycle Event)
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-81b31104-2cb6-4732-9531-7d10f5c80549 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.416s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:28:15 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:28:16 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:28:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:16 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504083.5412629, a8f0e31a-8842-4c6e-b7a2-0e733216cce1 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:28:18 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] VM Stopped (Lifecycle Event)
Jul 28 00:28:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5e3661a3-ee50-423a-9af4-7e52720fbd5c None None] [instance: a8f0e31a-8842-4c6e-b7a2-0e733216cce1] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:20 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:28:20 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:28:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7389MB free_disk=25.086395263671875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:28:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 773cf3d1-e98d-4002-bb1f-a3b33a36edac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b451d103-db00-4cea-86ed-d23cab6120f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 560f0547-6eb6-4009-87ba-8206a77c27e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance f468456b-a0e5-4b79-a88d-a2303ce5920b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance d602680c-94a4-4e0d-bfca-893873fdd80d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:28:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.697s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:22 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:28:22 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:28:22 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:28:22 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:28:22 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:28:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:28:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:28 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:28:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:28:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:28:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:28:28 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:28:29 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updating instance_info_cache with network_info: [{"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:28:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:28:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:28:31 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:28:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:31 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:28:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:45 user nova-compute[70709]: INFO nova.compute.manager [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Detaching volume bcd8b818-8ffa-4a00-b05b-15a3c29c16b0
Jul 28 00:28:45 user nova-compute[70709]: INFO nova.virt.block_device [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Attempting to driver detach volume bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 from mountpoint /dev/vdb
Jul 28 00:28:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Attempting to detach device vdb from instance f468456b-a0e5-4b79-a88d-a2303ce5920b from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:28:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:28:45 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:28:45 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:28:45 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:28:45 user nova-compute[70709]:   <serial>bcd8b818-8ffa-4a00-b05b-15a3c29c16b0</serial>
Jul 28 00:28:45 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:28:45 user nova-compute[70709]: </disk>
Jul 28 00:28:45 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:28:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:45 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Successfully detached device vdb from instance f468456b-a0e5-4b79-a88d-a2303ce5920b from the persistent domain config.
Jul 28 00:28:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f468456b-a0e5-4b79-a88d-a2303ce5920b from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:28:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:28:45 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:28:45 user nova-compute[70709]:   <source dev="/dev/sdf"/>
Jul 28 00:28:45 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:28:45 user nova-compute[70709]:   <serial>bcd8b818-8ffa-4a00-b05b-15a3c29c16b0</serial>
Jul 28 00:28:45 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:28:45 user nova-compute[70709]: </disk>
Jul 28 00:28:45 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504126.2089884, f468456b-a0e5-4b79-a88d-a2303ce5920b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f468456b-a0e5-4b79-a88d-a2303ce5920b {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:28:46 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Successfully detached device vdb from instance f468456b-a0e5-4b79-a88d-a2303ce5920b from the live domain config.
Jul 28 00:28:46 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEneykiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:28:46 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e3f50c-3b66-4cab-bf95-6998ef5ee121]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:28:46 user nova-compute[70709]: No targets found.
Jul 28 00:28:46 user nova-compute[70709]: iSNS:
Jul 28 00:28:46 user nova-compute[70709]: No targets found.
Jul 28 00:28:46 user nova-compute[70709]: STATIC:
Jul 28 00:28:46 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd
Jul 28 00:28:46 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:28:46 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:28:46 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0
Jul 28 00:28:46 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:28:46 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:28:46 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:28:46 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:28:46 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:28:46 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57
Jul 28 00:28:46 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:28:46 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:28:46 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4
Jul 28 00:28:46 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:28:46 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:28:46 user nova-compute[70709]: FIRMWARE:
Jul 28 00:28:46 user nova-compute[70709]: No targets found.
Jul 28 00:28:46 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:28:46 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:28:46 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8363ec1-03a6-45a6-8c0c-547cabe69dce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8916c1f5-fc56-4969-9345-1a0cfa72d881]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:28:46 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:28:46 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:28:46 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:28:46 user nova-compute[70709]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 (non-flash)
Jul 28 00:28:46 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:28:46 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:28:46 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:28:46 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:28:46 user nova-compute[70709]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 (non-flash)
Jul 28 00:28:46 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90277ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0'): ({'sdf'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Removing single pathed devices sdf {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9886d419-ec7d-41eb-a709-3467c3c8dfb1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[592522a0-3b0e-46f2-b3ac-ddd3d3d37c6a]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Flushing IO for device /dev/sdf {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[678a465c-1b47-4882-a1a6-a0a802c6c2f9]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdd4e59-51df-4f2e-ab03-28147d0185bf]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] SCSI volumes sdf have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff6955d-b6aa-497c-9725-32ad64f1e52c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0ca60d-a06b-4423-9ec0-9525c688b536]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0, portal: 172.16.0.220,3260]
Jul 28 00:28:46 user nova-compute[70709]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0, portal: 172.16.0.220,3260] successful.
Jul 28 00:28:46 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1adad0-3fae-4a64-a53c-3cad91bfc5cb]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] <== disconnect_volume: return (322ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:28:46 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'flavor' on Instance uuid f468456b-a0e5-4b79-a88d-a2303ce5920b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9490b503-1113-4a63-b418-7e0e60077ffb tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.914s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.805s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:47 user nova-compute[70709]: INFO nova.compute.manager [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Terminating instance
Jul 28 00:28:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-7f0c307e-2efc-4fa5-9849-49b74d038cfe req-66d30987-b594-4afe-9a0d-ae8e0cbb64d9 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-vif-unplugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7f0c307e-2efc-4fa5-9849-49b74d038cfe req-66d30987-b594-4afe-9a0d-ae8e0cbb64d9 service nova] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7f0c307e-2efc-4fa5-9849-49b74d038cfe req-66d30987-b594-4afe-9a0d-ae8e0cbb64d9 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7f0c307e-2efc-4fa5-9849-49b74d038cfe req-66d30987-b594-4afe-9a0d-ae8e0cbb64d9 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-7f0c307e-2efc-4fa5-9849-49b74d038cfe req-66d30987-b594-4afe-9a0d-ae8e0cbb64d9 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] No waiting events found dispatching network-vif-unplugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-7f0c307e-2efc-4fa5-9849-49b74d038cfe req-66d30987-b594-4afe-9a0d-ae8e0cbb64d9 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-vif-unplugged-04d723ad-66a0-49a0-af57-cb899673cc7b for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:48 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Instance destroyed successfully.
Jul 28 00:28:48 user nova-compute[70709]: DEBUG nova.objects.instance [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'resources' on Instance uuid f468456b-a0e5-4b79-a88d-a2303ce5920b {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-668339058',display_name='tempest-VolumesSnapshotTestJSON-instance-668339058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-668339058',id=31,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB95uvA7F6319/qhb68M6MXo/+wLfxyRWb3J1QysAovP7HVMM3nO+7uojoqdsc1nhvKS2sKijhVW7CfqryJt01afkBM8AH+e43qIO/fPiSBt6qQtRNlRSAPoC1hJWxw+zw==',key_name='tempest-keypair-401090212',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:26:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac4490eb04484a6c936f8268364f5458',ramdisk_id='',reservation_id='r-ta196hum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-720662141',owner_user_name='tempest-VolumesSnapshotTestJSON-720662141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:26:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce5a156400ad4eb5840168ab290161d1',uuid=f468456b-a0e5-4b79-a88d-a2303ce5920b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04d723ad-66a0-49a0-af57-cb899673cc7b", "address": "fa:16:3e:55:de:9c", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d723ad-66", "ovs_interfaceid": "04d723ad-66a0-49a0-af57-cb899673cc7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converting VIF {"id": "04d723ad-66a0-49a0-af57-cb899673cc7b", "address": "fa:16:3e:55:de:9c", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d723ad-66", "ovs_interfaceid": "04d723ad-66a0-49a0-af57-cb899673cc7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:de:9c,bridge_name='br-int',has_traffic_filtering=True,id=04d723ad-66a0-49a0-af57-cb899673cc7b,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d723ad-66') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_vif [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:de:9c,bridge_name='br-int',has_traffic_filtering=True,id=04d723ad-66a0-49a0-af57-cb899673cc7b,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d723ad-66') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04d723ad-66, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:28:48 user nova-compute[70709]: INFO os_vif [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:de:9c,bridge_name='br-int',has_traffic_filtering=True,id=04d723ad-66a0-49a0-af57-cb899673cc7b,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d723ad-66')
Jul 28 00:28:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEneykiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:28:48 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c443f408-ed96-4755-b2fb-b82788720c8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:28:48 user nova-compute[70709]: No targets found.
Jul 28 00:28:48 user nova-compute[70709]: iSNS:
Jul 28 00:28:48 user nova-compute[70709]: No targets found.
Jul 28 00:28:48 user nova-compute[70709]: STATIC:
Jul 28 00:28:48 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd
Jul 28 00:28:48 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:28:48 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:28:48 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:28:48 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:28:48 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:28:48 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57
Jul 28 00:28:48 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:28:48 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:28:48 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4
Jul 28 00:28:48 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:28:48 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:28:48 user nova-compute[70709]: FIRMWARE:
Jul 28 00:28:48 user nova-compute[70709]: No targets found.
Jul 28 00:28:48 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:28:48 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:28:48 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd8b818-8ffa-4a00-b05b-15a3c29c16b0', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4158afce-182b-40f2-94e8-f7301a66983f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2342498b-0edf-4576-af5a-03192fd60f72]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:28:48 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:28:48 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:28:48 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:28:48 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:28:48 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:28:48 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:28:48 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:28:48 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b8858ea70>, {}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Disconnecting from: [] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.111s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] <== disconnect_volume: return (112ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:28:48 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Deleting instance files /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b_del
Jul 28 00:28:48 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Deletion of /opt/stack/data/nova/instances/f468456b-a0e5-4b79-a88d-a2303ce5920b_del complete
Jul 28 00:28:48 user nova-compute[70709]: INFO nova.compute.manager [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Took 1.07 seconds to destroy the instance on the hypervisor.
Jul 28 00:28:48 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:28:48 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:28:49 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Took 1.11 seconds to deallocate network for instance.
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-61f53bf3-c38d-4f8a-bb31-0c631b6df27b req-d0a9c1cd-967a-49e8-ba14-6e8040c7717d service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-vif-deleted-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:49 user nova-compute[70709]: INFO nova.compute.manager [req-61f53bf3-c38d-4f8a-bb31-0c631b6df27b req-d0a9c1cd-967a-49e8-ba14-6e8040c7717d service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Neutron deleted interface 04d723ad-66a0-49a0-af57-cb899673cc7b; detaching it from the instance and deleting it from the info cache
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.network.neutron [req-61f53bf3-c38d-4f8a-bb31-0c631b6df27b req-d0a9c1cd-967a-49e8-ba14-6e8040c7717d service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:28:49 user nova-compute[70709]: WARNING nova.volume.cinder [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Attachment c1106d5e-e305-4f79-8af9-cd1f21063a3f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c1106d5e-e305-4f79-8af9-cd1f21063a3f. (HTTP 404) (Request-ID: req-3fe2d024-ef0c-4633-a251-29001ebcce84)
Jul 28 00:28:49 user nova-compute[70709]: INFO nova.compute.manager [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Took 0.03 seconds to detach 1 volumes for instance.
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-61f53bf3-c38d-4f8a-bb31-0c631b6df27b req-d0a9c1cd-967a-49e8-ba14-6e8040c7717d service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Detach interface failed, port_id=04d723ad-66a0-49a0-af57-cb899673cc7b, reason: Instance f468456b-a0e5-4b79-a88d-a2303ce5920b could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] No waiting events found dispatching network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:49 user nova-compute[70709]: WARNING nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received unexpected event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b for instance with vm_state deleted and task_state None.
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] No waiting events found dispatching network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:49 user nova-compute[70709]: WARNING nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received unexpected event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b for instance with vm_state deleted and task_state None.
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] No waiting events found dispatching network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:49 user nova-compute[70709]: WARNING nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received unexpected event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b for instance with vm_state deleted and task_state None.
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-vif-unplugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] No waiting events found dispatching network-vif-unplugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:49 user nova-compute[70709]: WARNING nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received unexpected event network-vif-unplugged-04d723ad-66a0-49a0-af57-cb899673cc7b for instance with vm_state deleted and task_state None.
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Acquiring lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] No waiting events found dispatching network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:49 user nova-compute[70709]: WARNING nova.compute.manager [req-661ea10d-c788-47a4-b5b6-1fff10783164 req-affd07b5-fcac-4a05-a533-8b34275ff5f3 service nova] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Received unexpected event network-vif-plugged-04d723ad-66a0-49a0-af57-cb899673cc7b for instance with vm_state deleted and task_state None.
Jul 28 00:28:50 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:28:50 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:28:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:50 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Deleted allocations for instance f468456b-a0e5-4b79-a88d-a2303ce5920b
Jul 28 00:28:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d51cb39c-f8f6-4b47-a2f0-550c8555806b tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "f468456b-a0e5-4b79-a88d-a2303ce5920b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.843s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "d602680c-94a4-4e0d-bfca-893873fdd80d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:56 user nova-compute[70709]: INFO nova.compute.manager [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Terminating instance
Jul 28 00:28:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:28:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-feb320b6-096f-4a00-b345-db9ab089fdf3 req-62b88b3a-ce7b-4848-8938-1e2fcbb60689 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Received event network-vif-unplugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-feb320b6-096f-4a00-b345-db9ab089fdf3 req-62b88b3a-ce7b-4848-8938-1e2fcbb60689 service nova] Acquiring lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-feb320b6-096f-4a00-b345-db9ab089fdf3 req-62b88b3a-ce7b-4848-8938-1e2fcbb60689 service nova] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-feb320b6-096f-4a00-b345-db9ab089fdf3 req-62b88b3a-ce7b-4848-8938-1e2fcbb60689 service nova] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-feb320b6-096f-4a00-b345-db9ab089fdf3 req-62b88b3a-ce7b-4848-8938-1e2fcbb60689 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] No waiting events found dispatching network-vif-unplugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-feb320b6-096f-4a00-b345-db9ab089fdf3 req-62b88b3a-ce7b-4848-8938-1e2fcbb60689 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Received event network-vif-unplugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:28:57 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Instance destroyed successfully.
Jul 28 00:28:57 user nova-compute[70709]: DEBUG nova.objects.instance [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lazy-loading 'resources' on Instance uuid d602680c-94a4-4e0d-bfca-893873fdd80d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-135040119',display_name='tempest-VolumesActionsTest-instance-135040119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-135040119',id=33,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:27:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='849c1603c3d6407fa7dafb0bef6af892',ramdisk_id='',reservation_id='r-0cescark',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-385116109',owner_user_name='tempest-VolumesActionsTest-385116109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:27:13Z,user_data=None,user_id='5740d1a26a6242db951f3283bed1c374',uuid=d602680c-94a4-4e0d-bfca-893873fdd80d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "address": "fa:16:3e:af:a4:94", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17926b1-62", "ovs_interfaceid": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converting VIF {"id": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "address": "fa:16:3e:af:a4:94", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17926b1-62", "ovs_interfaceid": "d17926b1-62ca-41c6-a8c7-64ac24d2fd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:a4:94,bridge_name='br-int',has_traffic_filtering=True,id=d17926b1-62ca-41c6-a8c7-64ac24d2fd9a,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17926b1-62') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG os_vif [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:a4:94,bridge_name='br-int',has_traffic_filtering=True,id=d17926b1-62ca-41c6-a8c7-64ac24d2fd9a,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17926b1-62') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd17926b1-62, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:28:57 user nova-compute[70709]: INFO os_vif [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:a4:94,bridge_name='br-int',has_traffic_filtering=True,id=d17926b1-62ca-41c6-a8c7-64ac24d2fd9a,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17926b1-62')
Jul 28 00:28:57 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Deleting instance files /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d_del
Jul 28 00:28:57 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Deletion of /opt/stack/data/nova/instances/d602680c-94a4-4e0d-bfca-893873fdd80d_del complete
Jul 28 00:28:57 user nova-compute[70709]: INFO nova.compute.manager [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Took 0.67 seconds to destroy the instance on the hypervisor.
Jul 28 00:28:57 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:28:57 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:28:58 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:28:58 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Took 1.00 seconds to deallocate network for instance.
Jul 28 00:28:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:58 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:28:58 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:28:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:58 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Deleted allocations for instance d602680c-94a4-4e0d-bfca-893873fdd80d
Jul 28 00:28:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-66f3eb67-0a80-45da-a0d0-def9f717e14c tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.171s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-6eeaf9d2-99b7-4f0a-b6ea-4cc3d0a31f05 req-731f8fc2-6c46-4696-a3e1-39de02769824 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Received event network-vif-plugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:28:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6eeaf9d2-99b7-4f0a-b6ea-4cc3d0a31f05 req-731f8fc2-6c46-4696-a3e1-39de02769824 service nova] Acquiring lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:28:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6eeaf9d2-99b7-4f0a-b6ea-4cc3d0a31f05 req-731f8fc2-6c46-4696-a3e1-39de02769824 service nova] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:28:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6eeaf9d2-99b7-4f0a-b6ea-4cc3d0a31f05 req-731f8fc2-6c46-4696-a3e1-39de02769824 service nova] Lock "d602680c-94a4-4e0d-bfca-893873fdd80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:28:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-6eeaf9d2-99b7-4f0a-b6ea-4cc3d0a31f05 req-731f8fc2-6c46-4696-a3e1-39de02769824 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] No waiting events found dispatching network-vif-plugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:28:59 user nova-compute[70709]: WARNING nova.compute.manager [req-6eeaf9d2-99b7-4f0a-b6ea-4cc3d0a31f05 req-731f8fc2-6c46-4696-a3e1-39de02769824 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Received unexpected event network-vif-plugged-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a for instance with vm_state deleted and task_state None.
Jul 28 00:28:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-6eeaf9d2-99b7-4f0a-b6ea-4cc3d0a31f05 req-731f8fc2-6c46-4696-a3e1-39de02769824 service nova] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Received event network-vif-deleted-d17926b1-62ca-41c6-a8c7-64ac24d2fd9a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:29:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:03 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504128.3659513, f468456b-a0e5-4b79-a88d-a2303ce5920b => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:29:03 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] VM Stopped (Lifecycle Event)
Jul 28 00:29:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a9c46ab5-2c38-4669-b752-e833df3e2b65 None None] [instance: f468456b-a0e5-4b79-a88d-a2303ce5920b] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:29:04 user nova-compute[70709]: INFO nova.compute.manager [None req-e2fe922d-fa6e-4d03-8a5c-d47a54cffad5 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Get console output
Jul 28 00:29:04 user nova-compute[70709]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 28 00:29:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:12 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504137.2637122, d602680c-94a4-4e0d-bfca-893873fdd80d => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:29:12 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] VM Stopped (Lifecycle Event)
Jul 28 00:29:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e4df5124-013e-4181-985a-a51c627a22f5 None None] [instance: d602680c-94a4-4e0d-bfca-893873fdd80d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:29:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:16 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:29:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:29:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:29:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:17 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:20 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:29:20 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=25.128219604492188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 773cf3d1-e98d-4002-bb1f-a3b33a36edac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b451d103-db00-4cea-86ed-d23cab6120f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 560f0547-6eb6-4009-87ba-8206a77c27e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:29:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:29:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:29:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:29:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:29:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:29:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:29:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:28 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:29:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:29:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:29:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:29:29 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:29:30 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Updating instance_info_cache with network_info: [{"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:29:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-159a0ce2-f6b6-45bf-a743-74da642a79fe" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:29:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:29:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:31 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:29:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:41 user nova-compute[70709]: INFO nova.compute.manager [None req-c6ef1061-4e33-47f1-b9f9-feb72e14c98d tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Unrescuing
Jul 28 00:29:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c6ef1061-4e33-47f1-b9f9-feb72e14c98d tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:29:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c6ef1061-4e33-47f1-b9f9-feb72e14c98d tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquired lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:29:41 user nova-compute[70709]: DEBUG nova.network.neutron [None req-c6ef1061-4e33-47f1-b9f9-feb72e14c98d tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG nova.network.neutron [None req-c6ef1061-4e33-47f1-b9f9-feb72e14c98d tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Updating instance_info_cache with network_info: [{"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c6ef1061-4e33-47f1-b9f9-feb72e14c98d tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Releasing lock "refresh_cache-7f93835f-ae7f-430b-b30b-33a82ae6e2a2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG nova.objects.instance [None req-c6ef1061-4e33-47f1-b9f9-feb72e14c98d tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'flavor' on Instance uuid 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-ccfa6a17-185f-4706-bcb8-44b3f1e0e2ca req-d60c437c-1ab1-4ea3-b33f-aa1b9366b9fd service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-unplugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ccfa6a17-185f-4706-bcb8-44b3f1e0e2ca req-d60c437c-1ab1-4ea3-b33f-aa1b9366b9fd service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ccfa6a17-185f-4706-bcb8-44b3f1e0e2ca req-d60c437c-1ab1-4ea3-b33f-aa1b9366b9fd service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ccfa6a17-185f-4706-bcb8-44b3f1e0e2ca req-d60c437c-1ab1-4ea3-b33f-aa1b9366b9fd service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-ccfa6a17-185f-4706-bcb8-44b3f1e0e2ca req-d60c437c-1ab1-4ea3-b33f-aa1b9366b9fd service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-unplugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:29:42 user nova-compute[70709]: WARNING nova.compute.manager [req-ccfa6a17-185f-4706-bcb8-44b3f1e0e2ca req-d60c437c-1ab1-4ea3-b33f-aa1b9366b9fd service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received unexpected event network-vif-unplugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:29:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:43 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Instance destroyed successfully.
Jul 28 00:29:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-5e0cdb74-396f-4af5-926b-df7b9a3b9922 req-7dffaeb8-7a4a-4939-ba31-98faab82e5d6 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:29:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5e0cdb74-396f-4af5-926b-df7b9a3b9922 req-7dffaeb8-7a4a-4939-ba31-98faab82e5d6 service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5e0cdb74-396f-4af5-926b-df7b9a3b9922 req-7dffaeb8-7a4a-4939-ba31-98faab82e5d6 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5e0cdb74-396f-4af5-926b-df7b9a3b9922 req-7dffaeb8-7a4a-4939-ba31-98faab82e5d6 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-5e0cdb74-396f-4af5-926b-df7b9a3b9922 req-7dffaeb8-7a4a-4939-ba31-98faab82e5d6 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:29:44 user nova-compute[70709]: WARNING nova.compute.manager [req-5e0cdb74-396f-4af5-926b-df7b9a3b9922 req-7dffaeb8-7a4a-4939-ba31-98faab82e5d6 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received unexpected event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:29:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504186.8448648, 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:29:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] VM Resumed (Lifecycle Event)
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c6ef1061-4e33-47f1-b9f9-feb72e14c98d tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:29:46 user nova-compute[70709]: WARNING nova.compute.manager [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received unexpected event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:29:46 user nova-compute[70709]: WARNING nova.compute.manager [req-6c19cfee-d8ec-4ff7-8d2a-a2329ed2d904 req-849816f5-0e53-48ef-a142-5f606a48e6fe service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received unexpected event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:29:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504186.848518, 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:29:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] VM Started (Lifecycle Event)
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:29:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:29:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "ef2b3139-5b7b-49e6-af46-10211f015b02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:29:49 user nova-compute[70709]: INFO nova.compute.claims [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Claim successful on node user
Jul 28 00:29:49 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:29:49 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:29:49 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:29:49 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:29:50 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Creating image(s)
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "/opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "/opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG nova.policy [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5740d1a26a6242db951f3283bed1c374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849c1603c3d6407fa7dafb0bef6af892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.168s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk 1073741824" returned: 0 in 0.052s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Cannot resize image /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lazy-loading 'migration_context' on Instance uuid ef2b3139-5b7b-49e6-af46-10211f015b02 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Ensure instance console log exists: /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:51 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Successfully created port: f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Successfully updated port: f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "refresh_cache-ef2b3139-5b7b-49e6-af46-10211f015b02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquired lock "refresh_cache-ef2b3139-5b7b-49e6-af46-10211f015b02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-01431ec7-d107-482d-8c0e-5fd68e6896ee req-7b13deca-84f5-4949-abd7-a169ca3afcb9 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Received event network-changed-f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-01431ec7-d107-482d-8c0e-5fd68e6896ee req-7b13deca-84f5-4949-abd7-a169ca3afcb9 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Refreshing instance network info cache due to event network-changed-f666dff5-5df4-40d4-a1bb-5c8604b148c8. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-01431ec7-d107-482d-8c0e-5fd68e6896ee req-7b13deca-84f5-4949-abd7-a169ca3afcb9 service nova] Acquiring lock "refresh_cache-ef2b3139-5b7b-49e6-af46-10211f015b02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Updating instance_info_cache with network_info: [{"id": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "address": "fa:16:3e:6c:19:d3", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf666dff5-5d", "ovs_interfaceid": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Releasing lock "refresh_cache-ef2b3139-5b7b-49e6-af46-10211f015b02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Instance network_info: |[{"id": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "address": "fa:16:3e:6c:19:d3", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf666dff5-5d", "ovs_interfaceid": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-01431ec7-d107-482d-8c0e-5fd68e6896ee req-7b13deca-84f5-4949-abd7-a169ca3afcb9 service nova] Acquired lock "refresh_cache-ef2b3139-5b7b-49e6-af46-10211f015b02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.network.neutron [req-01431ec7-d107-482d-8c0e-5fd68e6896ee req-7b13deca-84f5-4949-abd7-a169ca3afcb9 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Refreshing network info cache for port f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Start _get_guest_xml network_info=[{"id": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "address": "fa:16:3e:6c:19:d3", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf666dff5-5d", "ovs_interfaceid": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:29:52 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:29:52 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1882246927',display_name='tempest-VolumesActionsTest-instance-1882246927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1882246927',id=34,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='849c1603c3d6407fa7dafb0bef6af892',ramdisk_id='',reservation_id='r-11zjanei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-385116109',owner_user_name='tempest-VolumesActionsTest-385116109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:29:50Z,user_data=None,user_id='5740d1a26a6242db951f3283bed1c374',uuid=ef2b3139-5b7b-49e6-af46-10211f015b02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "address": "fa:16:3e:6c:19:d3", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf666dff5-5d", "ovs_interfaceid": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converting VIF {"id": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "address": "fa:16:3e:6c:19:d3", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf666dff5-5d", "ovs_interfaceid": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:19:d3,bridge_name='br-int',has_traffic_filtering=True,id=f666dff5-5df4-40d4-a1bb-5c8604b148c8,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf666dff5-5d') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lazy-loading 'pci_devices' on Instance uuid ef2b3139-5b7b-49e6-af46-10211f015b02 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:29:52 user nova-compute[70709]:   <uuid>ef2b3139-5b7b-49e6-af46-10211f015b02</uuid>
Jul 28 00:29:52 user nova-compute[70709]:   <name>instance-00000022</name>
Jul 28 00:29:52 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:29:52 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:29:52 user nova-compute[70709]:   <metadata>
Jul 28 00:29:52 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:29:52 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:29:52 user nova-compute[70709]:       <nova:name>tempest-VolumesActionsTest-instance-1882246927</nova:name>
Jul 28 00:29:52 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:29:52</nova:creationTime>
Jul 28 00:29:52 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:29:52 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:29:52 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:29:52 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:29:52 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:29:52 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:29:52 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:29:52 user nova-compute[70709]:       <nova:owner>
Jul 28 00:29:52 user nova-compute[70709]:         <nova:user uuid="5740d1a26a6242db951f3283bed1c374">tempest-VolumesActionsTest-385116109-project-member</nova:user>
Jul 28 00:29:52 user nova-compute[70709]:         <nova:project uuid="849c1603c3d6407fa7dafb0bef6af892">tempest-VolumesActionsTest-385116109</nova:project>
Jul 28 00:29:52 user nova-compute[70709]:       </nova:owner>
Jul 28 00:29:52 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:29:52 user nova-compute[70709]:       <nova:ports>
Jul 28 00:29:52 user nova-compute[70709]:         <nova:port uuid="f666dff5-5df4-40d4-a1bb-5c8604b148c8">
Jul 28 00:29:52 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 28 00:29:52 user nova-compute[70709]:         </nova:port>
Jul 28 00:29:52 user nova-compute[70709]:       </nova:ports>
Jul 28 00:29:52 user nova-compute[70709]:     </nova:instance>
Jul 28 00:29:52 user nova-compute[70709]:   </metadata>
Jul 28 00:29:52 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:29:52 user nova-compute[70709]:     <system>
Jul 28 00:29:52 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:29:52 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:29:52 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:29:52 user nova-compute[70709]:       <entry name="serial">ef2b3139-5b7b-49e6-af46-10211f015b02</entry>
Jul 28 00:29:52 user nova-compute[70709]:       <entry name="uuid">ef2b3139-5b7b-49e6-af46-10211f015b02</entry>
Jul 28 00:29:52 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:29:52 user nova-compute[70709]:     </system>
Jul 28 00:29:52 user nova-compute[70709]:   </sysinfo>
Jul 28 00:29:52 user nova-compute[70709]:   <os>
Jul 28 00:29:52 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:29:52 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:29:52 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:29:52 user nova-compute[70709]:   </os>
Jul 28 00:29:52 user nova-compute[70709]:   <features>
Jul 28 00:29:52 user nova-compute[70709]:     <acpi/>
Jul 28 00:29:52 user nova-compute[70709]:     <apic/>
Jul 28 00:29:52 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:29:52 user nova-compute[70709]:   </features>
Jul 28 00:29:52 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:29:52 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:29:52 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:29:52 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:29:52 user nova-compute[70709]:   </clock>
Jul 28 00:29:52 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:29:52 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:29:52 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:29:52 user nova-compute[70709]:   </cpu>
Jul 28 00:29:52 user nova-compute[70709]:   <devices>
Jul 28 00:29:52 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:29:52 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:29:52 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk"/>
Jul 28 00:29:52 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:29:52 user nova-compute[70709]:     </disk>
Jul 28 00:29:52 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:29:52 user nova-compute[70709]:       <mac address="fa:16:3e:6c:19:d3"/>
Jul 28 00:29:52 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:29:52 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:29:52 user nova-compute[70709]:       <target dev="tapf666dff5-5d"/>
Jul 28 00:29:52 user nova-compute[70709]:     </interface>
Jul 28 00:29:52 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:29:52 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/console.log" append="off"/>
Jul 28 00:29:52 user nova-compute[70709]:     </serial>
Jul 28 00:29:52 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:29:52 user nova-compute[70709]:     <video>
Jul 28 00:29:52 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:29:52 user nova-compute[70709]:     </video>
Jul 28 00:29:52 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:29:52 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:29:52 user nova-compute[70709]:     </rng>
Jul 28 00:29:52 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:29:52 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:29:52 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:29:52 user nova-compute[70709]:     </memballoon>
Jul 28 00:29:52 user nova-compute[70709]:   </devices>
Jul 28 00:29:52 user nova-compute[70709]: </domain>
Jul 28 00:29:52 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1882246927',display_name='tempest-VolumesActionsTest-instance-1882246927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1882246927',id=34,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='849c1603c3d6407fa7dafb0bef6af892',ramdisk_id='',reservation_id='r-11zjanei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-385116109',owner_user_name='tempest-VolumesActionsTest-385116109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:29:50Z,user_data=None,user_id='5740d1a26a6242db951f3283bed1c374',uuid=ef2b3139-5b7b-49e6-af46-10211f015b02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "address": "fa:16:3e:6c:19:d3", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf666dff5-5d", "ovs_interfaceid": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converting VIF {"id": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "address": "fa:16:3e:6c:19:d3", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf666dff5-5d", "ovs_interfaceid": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:19:d3,bridge_name='br-int',has_traffic_filtering=True,id=f666dff5-5df4-40d4-a1bb-5c8604b148c8,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf666dff5-5d') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG os_vif [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:19:d3,bridge_name='br-int',has_traffic_filtering=True,id=f666dff5-5df4-40d4-a1bb-5c8604b148c8,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf666dff5-5d') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf666dff5-5d, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf666dff5-5d, col_values=(('external_ids', {'iface-id': 'f666dff5-5df4-40d4-a1bb-5c8604b148c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:19:d3', 'vm-uuid': 'ef2b3139-5b7b-49e6-af46-10211f015b02'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:52 user nova-compute[70709]: INFO os_vif [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:19:d3,bridge_name='br-int',has_traffic_filtering=True,id=f666dff5-5df4-40d4-a1bb-5c8604b148c8,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf666dff5-5d')
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:29:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] No VIF found with MAC fa:16:3e:6c:19:d3, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:29:53 user nova-compute[70709]: DEBUG nova.network.neutron [req-01431ec7-d107-482d-8c0e-5fd68e6896ee req-7b13deca-84f5-4949-abd7-a169ca3afcb9 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Updated VIF entry in instance network info cache for port f666dff5-5df4-40d4-a1bb-5c8604b148c8. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:29:53 user nova-compute[70709]: DEBUG nova.network.neutron [req-01431ec7-d107-482d-8c0e-5fd68e6896ee req-7b13deca-84f5-4949-abd7-a169ca3afcb9 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Updating instance_info_cache with network_info: [{"id": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "address": "fa:16:3e:6c:19:d3", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf666dff5-5d", "ovs_interfaceid": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:29:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-01431ec7-d107-482d-8c0e-5fd68e6896ee req-7b13deca-84f5-4949-abd7-a169ca3afcb9 service nova] Releasing lock "refresh_cache-ef2b3139-5b7b-49e6-af46-10211f015b02" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:29:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-a8a36619-96be-4ce8-9da5-8f4e78129c4a req-c80cfcb3-2d7b-489e-b9f6-df6fedcb903f service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Received event network-vif-plugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:29:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8a36619-96be-4ce8-9da5-8f4e78129c4a req-c80cfcb3-2d7b-489e-b9f6-df6fedcb903f service nova] Acquiring lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8a36619-96be-4ce8-9da5-8f4e78129c4a req-c80cfcb3-2d7b-489e-b9f6-df6fedcb903f service nova] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a8a36619-96be-4ce8-9da5-8f4e78129c4a req-c80cfcb3-2d7b-489e-b9f6-df6fedcb903f service nova] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-a8a36619-96be-4ce8-9da5-8f4e78129c4a req-c80cfcb3-2d7b-489e-b9f6-df6fedcb903f service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] No waiting events found dispatching network-vif-plugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:29:54 user nova-compute[70709]: WARNING nova.compute.manager [req-a8a36619-96be-4ce8-9da5-8f4e78129c4a req-c80cfcb3-2d7b-489e-b9f6-df6fedcb903f service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Received unexpected event network-vif-plugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 for instance with vm_state building and task_state spawning.
Jul 28 00:29:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-ec72e05b-5a25-429c-96e1-35ec13f94d60 req-a60b5e4b-997f-41cc-b804-8534ea2e1c0c service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Received event network-vif-plugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ec72e05b-5a25-429c-96e1-35ec13f94d60 req-a60b5e4b-997f-41cc-b804-8534ea2e1c0c service nova] Acquiring lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ec72e05b-5a25-429c-96e1-35ec13f94d60 req-a60b5e4b-997f-41cc-b804-8534ea2e1c0c service nova] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ec72e05b-5a25-429c-96e1-35ec13f94d60 req-a60b5e4b-997f-41cc-b804-8534ea2e1c0c service nova] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-ec72e05b-5a25-429c-96e1-35ec13f94d60 req-a60b5e4b-997f-41cc-b804-8534ea2e1c0c service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] No waiting events found dispatching network-vif-plugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:29:56 user nova-compute[70709]: WARNING nova.compute.manager [req-ec72e05b-5a25-429c-96e1-35ec13f94d60 req-a60b5e4b-997f-41cc-b804-8534ea2e1c0c service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Received unexpected event network-vif-plugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 for instance with vm_state building and task_state spawning.
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504196.9285526, ef2b3139-5b7b-49e6-af46-10211f015b02 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:29:56 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] VM Resumed (Lifecycle Event)
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:29:56 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Instance spawned successfully.
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:29:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:29:56 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:29:57 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504196.9331548, ef2b3139-5b7b-49e6-af46-10211f015b02 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:29:57 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] VM Started (Lifecycle Event)
Jul 28 00:29:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:29:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:29:57 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:29:57 user nova-compute[70709]: INFO nova.compute.manager [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Took 7.05 seconds to spawn the instance on the hypervisor.
Jul 28 00:29:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:29:57 user nova-compute[70709]: INFO nova.compute.manager [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Took 7.90 seconds to build instance.
Jul 28 00:29:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a8900625-c992-4a4b-b7d3-b8779cee2cc4 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.049s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:29:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:29:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-7fffcc26-90b4-4ecd-8d4e-e41523ce7a19 req-5b966591-dd14-49e8-95ef-caa1d0e0e699 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-changed-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:29:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-7fffcc26-90b4-4ecd-8d4e-e41523ce7a19 req-5b966591-dd14-49e8-95ef-caa1d0e0e699 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Refreshing instance network info cache due to event network-changed-e3bd2d01-d61d-4d30-a088-13f85c724ce1. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:29:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7fffcc26-90b4-4ecd-8d4e-e41523ce7a19 req-5b966591-dd14-49e8-95ef-caa1d0e0e699 service nova] Acquiring lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:29:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7fffcc26-90b4-4ecd-8d4e-e41523ce7a19 req-5b966591-dd14-49e8-95ef-caa1d0e0e699 service nova] Acquired lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:29:59 user nova-compute[70709]: DEBUG nova.network.neutron [req-7fffcc26-90b4-4ecd-8d4e-e41523ce7a19 req-5b966591-dd14-49e8-95ef-caa1d0e0e699 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Refreshing network info cache for port e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:30:00 user nova-compute[70709]: DEBUG nova.network.neutron [req-7fffcc26-90b4-4ecd-8d4e-e41523ce7a19 req-5b966591-dd14-49e8-95ef-caa1d0e0e699 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updated VIF entry in instance network info cache for port e3bd2d01-d61d-4d30-a088-13f85c724ce1. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:30:00 user nova-compute[70709]: DEBUG nova.network.neutron [req-7fffcc26-90b4-4ecd-8d4e-e41523ce7a19 req-5b966591-dd14-49e8-95ef-caa1d0e0e699 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updating instance_info_cache with network_info: [{"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:30:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7fffcc26-90b4-4ecd-8d4e-e41523ce7a19 req-5b966591-dd14-49e8-95ef-caa1d0e0e699 service nova] Releasing lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:30:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-2efa9faf-2a26-4ec4-9f59-9cef5434149a req-e21d636d-e66d-41fe-86fe-b387d6a1ef35 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-changed-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-2efa9faf-2a26-4ec4-9f59-9cef5434149a req-e21d636d-e66d-41fe-86fe-b387d6a1ef35 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Refreshing instance network info cache due to event network-changed-e3bd2d01-d61d-4d30-a088-13f85c724ce1. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:30:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2efa9faf-2a26-4ec4-9f59-9cef5434149a req-e21d636d-e66d-41fe-86fe-b387d6a1ef35 service nova] Acquiring lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:30:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2efa9faf-2a26-4ec4-9f59-9cef5434149a req-e21d636d-e66d-41fe-86fe-b387d6a1ef35 service nova] Acquired lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:30:00 user nova-compute[70709]: DEBUG nova.network.neutron [req-2efa9faf-2a26-4ec4-9f59-9cef5434149a req-e21d636d-e66d-41fe-86fe-b387d6a1ef35 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Refreshing network info cache for port e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:30:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:00 user nova-compute[70709]: INFO nova.compute.manager [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Detaching volume 94d4109b-f33a-4d07-9581-1e35034847d4
Jul 28 00:30:01 user nova-compute[70709]: INFO nova.virt.block_device [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Attempting to driver detach volume 94d4109b-f33a-4d07-9581-1e35034847d4 from mountpoint /dev/vdb
Jul 28 00:30:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Attempting to detach device vdb from instance 560f0547-6eb6-4009-87ba-8206a77c27e8 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:30:01 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:30:01 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:30:01 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:30:01 user nova-compute[70709]:   <serial>94d4109b-f33a-4d07-9581-1e35034847d4</serial>
Jul 28 00:30:01 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:30:01 user nova-compute[70709]: </disk>
Jul 28 00:30:01 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:30:01 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Successfully detached device vdb from instance 560f0547-6eb6-4009-87ba-8206a77c27e8 from the persistent domain config.
Jul 28 00:30:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 560f0547-6eb6-4009-87ba-8206a77c27e8 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:30:01 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:30:01 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:30:01 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:30:01 user nova-compute[70709]:   <serial>94d4109b-f33a-4d07-9581-1e35034847d4</serial>
Jul 28 00:30:01 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:30:01 user nova-compute[70709]: </disk>
Jul 28 00:30:01 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG nova.network.neutron [req-2efa9faf-2a26-4ec4-9f59-9cef5434149a req-e21d636d-e66d-41fe-86fe-b387d6a1ef35 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updated VIF entry in instance network info cache for port e3bd2d01-d61d-4d30-a088-13f85c724ce1. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG nova.network.neutron [req-2efa9faf-2a26-4ec4-9f59-9cef5434149a req-e21d636d-e66d-41fe-86fe-b387d6a1ef35 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updating instance_info_cache with network_info: [{"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2efa9faf-2a26-4ec4-9f59-9cef5434149a req-e21d636d-e66d-41fe-86fe-b387d6a1ef35 service nova] Releasing lock "refresh_cache-560f0547-6eb6-4009-87ba-8206a77c27e8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504201.6404655, 560f0547-6eb6-4009-87ba-8206a77c27e8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 560f0547-6eb6-4009-87ba-8206a77c27e8 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:30:01 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Successfully detached device vdb from instance 560f0547-6eb6-4009-87ba-8206a77c27e8 from the live domain config.
Jul 28 00:30:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDYNMxZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:30:01 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b96576-4b8e-44af-9eee-0efee2cc4d1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:30:01 user nova-compute[70709]: No targets found.
Jul 28 00:30:01 user nova-compute[70709]: iSNS:
Jul 28 00:30:01 user nova-compute[70709]: No targets found.
Jul 28 00:30:01 user nova-compute[70709]: STATIC:
Jul 28 00:30:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd
Jul 28 00:30:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:30:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:30:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:30:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:30:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:30:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57
Jul 28 00:30:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:30:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:30:01 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4
Jul 28 00:30:01 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:30:01 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:30:01 user nova-compute[70709]: FIRMWARE:
Jul 28 00:30:01 user nova-compute[70709]: No targets found.
Jul 28 00:30:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:30:01 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:30:01 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3436d1f-64fb-4893-bc69-83c81dfae4a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcd8c00-41d8-4fb9-93d2-4c927a00a6b7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:30:01 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:30:01 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:30:01 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:30:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:30:01 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:30:01 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:30:01 user nova-compute[70709]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 (non-flash)
Jul 28 00:30:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b9025b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4'): ({'sde'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Removing single pathed devices sde {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1a870b-c59b-47ce-b539-8d221efe9f06]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33ef683-2374-42e3-96fe-b25e9868ba7c]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Flushing IO for device /dev/sde {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b6307a-5dc4-40ea-b359-c47cd3b69e51]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc6dfb1-242d-45d1-900f-77270899aca2]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6077f60f-abfd-4018-8063-767b2cc7bb0e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce15eb21-bdf1-4541-ae26-3c13962b0c23]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4, portal: 172.16.0.220,3260]
Jul 28 00:30:01 user nova-compute[70709]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4, portal: 172.16.0.220,3260] successful.
Jul 28 00:30:01 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d4109b-f33a-4d07-9581-1e35034847d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bf733a-e90c-4cc1-aff2-12bd2ac5bad7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:30:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] <== disconnect_volume: return (373ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:30:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:30:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:02 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'flavor' on Instance uuid 560f0547-6eb6-4009-87ba-8206a77c27e8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:30:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a1f4ff41-a9c5-4fbf-a7d7-cfc07c2610da tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.976s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:30:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:30:03 user nova-compute[70709]: INFO nova.compute.claims [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Claim successful on node user
Jul 28 00:30:03 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:30:03 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:30:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:30:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.policy [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce5a156400ad4eb5840168ab290161d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4490eb04484a6c936f8268364f5458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:30:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Creating image(s)
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "/opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "/opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.165s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk 1073741824" returned: 0 in 0.058s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.165s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Cannot resize image /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.objects.instance [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'migration_context' on Instance uuid a7f9043f-80b2-4661-a43e-94e1f2816d7a {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Successfully created port: c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Ensure instance console log exists: /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b451d103-db00-4cea-86ed-d23cab6120f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:05 user nova-compute[70709]: INFO nova.compute.manager [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Terminating instance
Jul 28 00:30:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-ed10a321-41b3-45d0-856d-ad75822c5747 req-f294478c-b576-4016-becf-59447aeb5e04 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-vif-unplugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ed10a321-41b3-45d0-856d-ad75822c5747 req-f294478c-b576-4016-becf-59447aeb5e04 service nova] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ed10a321-41b3-45d0-856d-ad75822c5747 req-f294478c-b576-4016-becf-59447aeb5e04 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ed10a321-41b3-45d0-856d-ad75822c5747 req-f294478c-b576-4016-becf-59447aeb5e04 service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-ed10a321-41b3-45d0-856d-ad75822c5747 req-f294478c-b576-4016-becf-59447aeb5e04 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] No waiting events found dispatching network-vif-unplugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-ed10a321-41b3-45d0-856d-ad75822c5747 req-f294478c-b576-4016-becf-59447aeb5e04 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-vif-unplugged-23cdc0f2-530f-439d-b533-dea81f764fdf for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Instance destroyed successfully.
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.objects.instance [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'resources' on Instance uuid b451d103-db00-4cea-86ed-d23cab6120f5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Successfully updated port: c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1501930603',display_name='tempest-ServerActionsTestOtherA-server-1501930603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1501930603',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:25:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-7hnta9w3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:27:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b451d103-db00-4cea-86ed-d23cab6120f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "23cdc0f2-530f-439d-b533-dea81f764fdf", "address": "fa:16:3e:a1:ba:61", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cdc0f2-53", "ovs_interfaceid": "23cdc0f2-530f-439d-b533-dea81f764fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_vif [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "refresh_cache-a7f9043f-80b2-4661-a43e-94e1f2816d7a" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquired lock "refresh_cache-a7f9043f-80b2-4661-a43e-94e1f2816d7a" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23cdc0f2-53, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:30:06 user nova-compute[70709]: INFO os_vif [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ba:61,bridge_name='br-int',has_traffic_filtering=True,id=23cdc0f2-530f-439d-b533-dea81f764fdf,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cdc0f2-53')
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUCivjol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:30:06 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d19dfdd-211d-40a3-b9f3-a81e6cc4db84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:30:06 user nova-compute[70709]: No targets found.
Jul 28 00:30:06 user nova-compute[70709]: iSNS:
Jul 28 00:30:06 user nova-compute[70709]: No targets found.
Jul 28 00:30:06 user nova-compute[70709]: STATIC:
Jul 28 00:30:06 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd
Jul 28 00:30:06 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:30:06 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:30:06 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:30:06 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:30:06 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:30:06 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57
Jul 28 00:30:06 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:30:06 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:30:06 user nova-compute[70709]: FIRMWARE:
Jul 28 00:30:06 user nova-compute[70709]: No targets found.
Jul 28 00:30:06 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:30:06 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:30:06 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f5fcdb-ff84-4022-a9c0-452ce5b09473]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2934be8b-c403-4e9f-815a-e7d632660a8f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:30:06 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:30:06 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:30:06 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:30:06 user nova-compute[70709]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd (non-flash)
Jul 28 00:30:06 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:30:06 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b8857e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd'): ({'sdc'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Removing single pathed devices sdc {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-786c9314-de99-4ef8-a9d8-e5275cebd864 req-213623f0-5191-47cb-90db-0cf7cfc58516 service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Received event network-changed-c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-786c9314-de99-4ef8-a9d8-e5275cebd864 req-213623f0-5191-47cb-90db-0cf7cfc58516 service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Refreshing instance network info cache due to event network-changed-c5e74fc2-cd12-49a5-ae41-98730d5aebde. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-786c9314-de99-4ef8-a9d8-e5275cebd864 req-213623f0-5191-47cb-90db-0cf7cfc58516 service nova] Acquiring lock "refresh_cache-a7f9043f-80b2-4661-a43e-94e1f2816d7a" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7ce951-9948-41b3-9f45-8b8c8e742211]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ca68fa-22a6-4664-b0d7-daee6a84e463]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Flushing IO for device /dev/sdc {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59adc68-88bf-46c4-b1c6-bd0bf4cd9581]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba677e71-05eb-483c-b6d8-843343a54b05]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26136313263333866', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1e49b58d', '/dev/disk/by-id/scsi-1SCST_BIO1e49b58d-a612c38fc851bdcf') {{(pid=82455) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[668e02cb-0a43-42ef-80e8-3ea6c875b9b0]: (4, None) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2893e03f-d7c4-46dc-9507-fbad70309266]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[336a138e-513a-43ad-8913-d887d399ce77]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260]
Jul 28 00:30:06 user nova-compute[70709]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd, portal: 172.16.0.220,3260] successful.
Jul 28 00:30:06 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c4acdd-1e96-4dc5-9c0f-78668c233efd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[61276674-6d6d-404a-9f4c-99f3bdde741b]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] <== disconnect_volume: return (389ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:30:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Deleting instance files /opt/stack/data/nova/instances/b451d103-db00-4cea-86ed-d23cab6120f5_del
Jul 28 00:30:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Deletion of /opt/stack/data/nova/instances/b451d103-db00-4cea-86ed-d23cab6120f5_del complete
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.neutron [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Updating instance_info_cache with network_info: [{"id": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "address": "fa:16:3e:51:dd:d5", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e74fc2-cd", "ovs_interfaceid": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Releasing lock "refresh_cache-a7f9043f-80b2-4661-a43e-94e1f2816d7a" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Instance network_info: |[{"id": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "address": "fa:16:3e:51:dd:d5", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e74fc2-cd", "ovs_interfaceid": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-786c9314-de99-4ef8-a9d8-e5275cebd864 req-213623f0-5191-47cb-90db-0cf7cfc58516 service nova] Acquired lock "refresh_cache-a7f9043f-80b2-4661-a43e-94e1f2816d7a" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.neutron [req-786c9314-de99-4ef8-a9d8-e5275cebd864 req-213623f0-5191-47cb-90db-0cf7cfc58516 service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Refreshing network info cache for port c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Start _get_guest_xml network_info=[{"id": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "address": "fa:16:3e:51:dd:d5", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e74fc2-cd", "ovs_interfaceid": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:30:06 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:30:06 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2070125239',display_name='tempest-VolumesSnapshotTestJSON-instance-2070125239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2070125239',id=35,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFVMPkO6iavJbOCGhRXbBl9zooNSOKHG7WItk0gZjKv5AbBFRAwQhmvgX9Z/Z1HGs/J396bI/Trpw22w3Eu4WvoZPuE9AT4/B9bgwKz7Kr4He2L2z/SJ5Hr1fRwXafEdA==',key_name='tempest-keypair-2137992995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4490eb04484a6c936f8268364f5458',ramdisk_id='',reservation_id='r-qt8yt90f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-720662141',owner_user_name='tempest-VolumesSnapshotTestJSON-720662141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce5a156400ad4eb5840168ab290161d1',uuid=a7f9043f-80b2-4661-a43e-94e1f2816d7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "address": "fa:16:3e:51:dd:d5", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e74fc2-cd", "ovs_interfaceid": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converting VIF {"id": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "address": "fa:16:3e:51:dd:d5", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e74fc2-cd", "ovs_interfaceid": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5e74fc2-cd12-49a5-ae41-98730d5aebde,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e74fc2-cd') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.objects.instance [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'pci_devices' on Instance uuid a7f9043f-80b2-4661-a43e-94e1f2816d7a {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:30:06 user nova-compute[70709]:   <uuid>a7f9043f-80b2-4661-a43e-94e1f2816d7a</uuid>
Jul 28 00:30:06 user nova-compute[70709]:   <name>instance-00000023</name>
Jul 28 00:30:06 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:30:06 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:30:06 user nova-compute[70709]:   <metadata>
Jul 28 00:30:06 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:30:06 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:30:06 user nova-compute[70709]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2070125239</nova:name>
Jul 28 00:30:06 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:30:06</nova:creationTime>
Jul 28 00:30:06 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:30:06 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:30:06 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:30:06 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:30:06 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:30:06 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:30:06 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:30:06 user nova-compute[70709]:       <nova:owner>
Jul 28 00:30:06 user nova-compute[70709]:         <nova:user uuid="ce5a156400ad4eb5840168ab290161d1">tempest-VolumesSnapshotTestJSON-720662141-project-member</nova:user>
Jul 28 00:30:06 user nova-compute[70709]:         <nova:project uuid="ac4490eb04484a6c936f8268364f5458">tempest-VolumesSnapshotTestJSON-720662141</nova:project>
Jul 28 00:30:06 user nova-compute[70709]:       </nova:owner>
Jul 28 00:30:06 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:30:06 user nova-compute[70709]:       <nova:ports>
Jul 28 00:30:06 user nova-compute[70709]:         <nova:port uuid="c5e74fc2-cd12-49a5-ae41-98730d5aebde">
Jul 28 00:30:06 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 28 00:30:06 user nova-compute[70709]:         </nova:port>
Jul 28 00:30:06 user nova-compute[70709]:       </nova:ports>
Jul 28 00:30:06 user nova-compute[70709]:     </nova:instance>
Jul 28 00:30:06 user nova-compute[70709]:   </metadata>
Jul 28 00:30:06 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:30:06 user nova-compute[70709]:     <system>
Jul 28 00:30:06 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:30:06 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:30:06 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:30:06 user nova-compute[70709]:       <entry name="serial">a7f9043f-80b2-4661-a43e-94e1f2816d7a</entry>
Jul 28 00:30:06 user nova-compute[70709]:       <entry name="uuid">a7f9043f-80b2-4661-a43e-94e1f2816d7a</entry>
Jul 28 00:30:06 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:30:06 user nova-compute[70709]:     </system>
Jul 28 00:30:06 user nova-compute[70709]:   </sysinfo>
Jul 28 00:30:06 user nova-compute[70709]:   <os>
Jul 28 00:30:06 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:30:06 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:30:06 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:30:06 user nova-compute[70709]:   </os>
Jul 28 00:30:06 user nova-compute[70709]:   <features>
Jul 28 00:30:06 user nova-compute[70709]:     <acpi/>
Jul 28 00:30:06 user nova-compute[70709]:     <apic/>
Jul 28 00:30:06 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:30:06 user nova-compute[70709]:   </features>
Jul 28 00:30:06 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:30:06 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:30:06 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:30:06 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:30:06 user nova-compute[70709]:   </clock>
Jul 28 00:30:06 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:30:06 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:30:06 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:30:06 user nova-compute[70709]:   </cpu>
Jul 28 00:30:06 user nova-compute[70709]:   <devices>
Jul 28 00:30:06 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:30:06 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:30:06 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk"/>
Jul 28 00:30:06 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:30:06 user nova-compute[70709]:     </disk>
Jul 28 00:30:06 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:30:06 user nova-compute[70709]:       <mac address="fa:16:3e:51:dd:d5"/>
Jul 28 00:30:06 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:30:06 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:30:06 user nova-compute[70709]:       <target dev="tapc5e74fc2-cd"/>
Jul 28 00:30:06 user nova-compute[70709]:     </interface>
Jul 28 00:30:06 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:30:06 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/console.log" append="off"/>
Jul 28 00:30:06 user nova-compute[70709]:     </serial>
Jul 28 00:30:06 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:30:06 user nova-compute[70709]:     <video>
Jul 28 00:30:06 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:30:06 user nova-compute[70709]:     </video>
Jul 28 00:30:06 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:30:06 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:30:06 user nova-compute[70709]:     </rng>
Jul 28 00:30:06 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:30:06 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:30:06 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:30:06 user nova-compute[70709]:     </memballoon>
Jul 28 00:30:06 user nova-compute[70709]:   </devices>
Jul 28 00:30:06 user nova-compute[70709]: </domain>
Jul 28 00:30:06 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2070125239',display_name='tempest-VolumesSnapshotTestJSON-instance-2070125239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2070125239',id=35,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFVMPkO6iavJbOCGhRXbBl9zooNSOKHG7WItk0gZjKv5AbBFRAwQhmvgX9Z/Z1HGs/J396bI/Trpw22w3Eu4WvoZPuE9AT4/B9bgwKz7Kr4He2L2z/SJ5Hr1fRwXafEdA==',key_name='tempest-keypair-2137992995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4490eb04484a6c936f8268364f5458',ramdisk_id='',reservation_id='r-qt8yt90f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-720662141',owner_user_name='tempest-VolumesSnapshotTestJSON-720662141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce5a156400ad4eb5840168ab290161d1',uuid=a7f9043f-80b2-4661-a43e-94e1f2816d7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "address": "fa:16:3e:51:dd:d5", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e74fc2-cd", "ovs_interfaceid": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converting VIF {"id": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "address": "fa:16:3e:51:dd:d5", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e74fc2-cd", "ovs_interfaceid": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5e74fc2-cd12-49a5-ae41-98730d5aebde,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e74fc2-cd') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG os_vif [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5e74fc2-cd12-49a5-ae41-98730d5aebde,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e74fc2-cd') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:30:06 user nova-compute[70709]: INFO nova.compute.manager [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Took 1.38 seconds to destroy the instance on the hypervisor.
Jul 28 00:30:06 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5e74fc2-cd, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5e74fc2-cd, col_values=(('external_ids', {'iface-id': 'c5e74fc2-cd12-49a5-ae41-98730d5aebde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:dd:d5', 'vm-uuid': 'a7f9043f-80b2-4661-a43e-94e1f2816d7a'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:06 user nova-compute[70709]: INFO os_vif [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5e74fc2-cd12-49a5-ae41-98730d5aebde,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e74fc2-cd')
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:30:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] No VIF found with MAC fa:16:3e:51:dd:d5, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:30:07 user nova-compute[70709]: DEBUG nova.network.neutron [req-786c9314-de99-4ef8-a9d8-e5275cebd864 req-213623f0-5191-47cb-90db-0cf7cfc58516 service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Updated VIF entry in instance network info cache for port c5e74fc2-cd12-49a5-ae41-98730d5aebde. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:30:07 user nova-compute[70709]: DEBUG nova.network.neutron [req-786c9314-de99-4ef8-a9d8-e5275cebd864 req-213623f0-5191-47cb-90db-0cf7cfc58516 service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Updating instance_info_cache with network_info: [{"id": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "address": "fa:16:3e:51:dd:d5", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e74fc2-cd", "ovs_interfaceid": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:30:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-786c9314-de99-4ef8-a9d8-e5275cebd864 req-213623f0-5191-47cb-90db-0cf7cfc58516 service nova] Releasing lock "refresh_cache-a7f9043f-80b2-4661-a43e-94e1f2816d7a" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:30:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-146ea585-8721-4c3e-b382-d644c499d30e req-e5b41185-3e54-4a7b-b201-d984c15a738e service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-146ea585-8721-4c3e-b382-d644c499d30e req-e5b41185-3e54-4a7b-b201-d984c15a738e service nova] Acquiring lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-146ea585-8721-4c3e-b382-d644c499d30e req-e5b41185-3e54-4a7b-b201-d984c15a738e service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-146ea585-8721-4c3e-b382-d644c499d30e req-e5b41185-3e54-4a7b-b201-d984c15a738e service nova] Lock "b451d103-db00-4cea-86ed-d23cab6120f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-146ea585-8721-4c3e-b382-d644c499d30e req-e5b41185-3e54-4a7b-b201-d984c15a738e service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] No waiting events found dispatching network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:30:07 user nova-compute[70709]: WARNING nova.compute.manager [req-146ea585-8721-4c3e-b382-d644c499d30e req-e5b41185-3e54-4a7b-b201-d984c15a738e service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received unexpected event network-vif-plugged-23cdc0f2-530f-439d-b533-dea81f764fdf for instance with vm_state active and task_state deleting.
Jul 28 00:30:07 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:30:07 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Took 1.32 seconds to deallocate network for instance.
Jul 28 00:30:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-d5dfc933-6a4a-4f69-8f71-c0f0b2d2a7fa req-d1246357-c2c2-4d2a-9a09-fc595a534dbf service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Received event network-vif-plugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d5dfc933-6a4a-4f69-8f71-c0f0b2d2a7fa req-d1246357-c2c2-4d2a-9a09-fc595a534dbf service nova] Acquiring lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d5dfc933-6a4a-4f69-8f71-c0f0b2d2a7fa req-d1246357-c2c2-4d2a-9a09-fc595a534dbf service nova] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d5dfc933-6a4a-4f69-8f71-c0f0b2d2a7fa req-d1246357-c2c2-4d2a-9a09-fc595a534dbf service nova] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-d5dfc933-6a4a-4f69-8f71-c0f0b2d2a7fa req-d1246357-c2c2-4d2a-9a09-fc595a534dbf service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] No waiting events found dispatching network-vif-plugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:30:08 user nova-compute[70709]: WARNING nova.compute.manager [req-d5dfc933-6a4a-4f69-8f71-c0f0b2d2a7fa req-d1246357-c2c2-4d2a-9a09-fc595a534dbf service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Received unexpected event network-vif-plugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde for instance with vm_state building and task_state spawning.
Jul 28 00:30:08 user nova-compute[70709]: INFO nova.compute.manager [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Took 0.90 seconds to detach 1 volumes for instance.
Jul 28 00:30:08 user nova-compute[70709]: DEBUG nova.compute.manager [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Deleting volume: 99c4acdd-1e96-4dc5-9c0f-78668c233efd {{(pid=70709) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 28 00:30:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:09 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:30:09 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:30:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:09 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Deleted allocations for instance b451d103-db00-4cea-86ed-d23cab6120f5
Jul 28 00:30:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-dff45c53-bbdb-4a78-92ec-196aad818918 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b451d103-db00-4cea-86ed-d23cab6120f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.303s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-5b5884a7-08b4-4cda-adc5-9bb45229ec47 req-ce5dfb87-d321-4c69-8aca-4f3b2bae57a9 service nova] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Received event network-vif-deleted-23cdc0f2-530f-439d-b533-dea81f764fdf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-be543163-572c-4cf7-b2eb-86d69d27cef7 req-c937e6f9-3deb-43f8-9794-aa94f7c3cfd9 service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Received event network-vif-plugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be543163-572c-4cf7-b2eb-86d69d27cef7 req-c937e6f9-3deb-43f8-9794-aa94f7c3cfd9 service nova] Acquiring lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be543163-572c-4cf7-b2eb-86d69d27cef7 req-c937e6f9-3deb-43f8-9794-aa94f7c3cfd9 service nova] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be543163-572c-4cf7-b2eb-86d69d27cef7 req-c937e6f9-3deb-43f8-9794-aa94f7c3cfd9 service nova] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-be543163-572c-4cf7-b2eb-86d69d27cef7 req-c937e6f9-3deb-43f8-9794-aa94f7c3cfd9 service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] No waiting events found dispatching network-vif-plugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:30:10 user nova-compute[70709]: WARNING nova.compute.manager [req-be543163-572c-4cf7-b2eb-86d69d27cef7 req-c937e6f9-3deb-43f8-9794-aa94f7c3cfd9 service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Received unexpected event network-vif-plugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde for instance with vm_state building and task_state spawning.
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504210.8659265, a7f9043f-80b2-4661-a43e-94e1f2816d7a => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:30:10 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] VM Resumed (Lifecycle Event)
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:30:10 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Instance spawned successfully.
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:10 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504210.8675992, a7f9043f-80b2-4661-a43e-94e1f2816d7a => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:30:10 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] VM Started (Lifecycle Event)
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:30:10 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:30:10 user nova-compute[70709]: INFO nova.compute.manager [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Took 6.79 seconds to spawn the instance on the hypervisor.
Jul 28 00:30:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:30:11 user nova-compute[70709]: INFO nova.compute.manager [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Took 7.76 seconds to build instance.
Jul 28 00:30:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25eca916-d8f1-46a1-950f-613a932c62e2 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.873s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "adea0906-40b1-4ebc-abe0-a4e24676c730" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:30:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:11 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:30:11 user nova-compute[70709]: INFO nova.compute.claims [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Claim successful on node user
Jul 28 00:30:12 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:30:12 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:30:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:30:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:30:12 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:30:12 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:30:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:30:12 user nova-compute[70709]: DEBUG nova.policy [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd994eb215f204b029d183b73539e3d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d88e18679b4bc49c010b68ca813dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:30:12 user nova-compute[70709]: INFO nova.virt.block_device [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Booting with volume snapshot 0bc336a9-4a76-4cda-a667-7053aa05c2cc at /dev/vda
Jul 28 00:30:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:13 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Successfully created port: f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Successfully updated port: f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "refresh_cache-adea0906-40b1-4ebc-abe0-a4e24676c730" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquired lock "refresh_cache-adea0906-40b1-4ebc-abe0-a4e24676c730" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-0813b169-da76-422e-a278-8a94fa37714f req-0ab1a4e1-e780-44f9-9ec1-f1fb058048ec service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Received event network-changed-f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-0813b169-da76-422e-a278-8a94fa37714f req-0ab1a4e1-e780-44f9-9ec1-f1fb058048ec service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Refreshing instance network info cache due to event network-changed-f39516f4-121e-4ca9-9dca-3526ee4e078a. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0813b169-da76-422e-a278-8a94fa37714f req-0ab1a4e1-e780-44f9-9ec1-f1fb058048ec service nova] Acquiring lock "refresh_cache-adea0906-40b1-4ebc-abe0-a4e24676c730" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Updating instance_info_cache with network_info: [{"id": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "address": "fa:16:3e:e2:a4:78", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39516f4-12", "ovs_interfaceid": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Releasing lock "refresh_cache-adea0906-40b1-4ebc-abe0-a4e24676c730" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Instance network_info: |[{"id": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "address": "fa:16:3e:e2:a4:78", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39516f4-12", "ovs_interfaceid": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0813b169-da76-422e-a278-8a94fa37714f req-0ab1a4e1-e780-44f9-9ec1-f1fb058048ec service nova] Acquired lock "refresh_cache-adea0906-40b1-4ebc-abe0-a4e24676c730" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:30:14 user nova-compute[70709]: DEBUG nova.network.neutron [req-0813b169-da76-422e-a278-8a94fa37714f req-0ab1a4e1-e780-44f9-9ec1-f1fb058048ec service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Refreshing network info cache for port f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:30:15 user nova-compute[70709]: DEBUG nova.network.neutron [req-0813b169-da76-422e-a278-8a94fa37714f req-0ab1a4e1-e780-44f9-9ec1-f1fb058048ec service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Updated VIF entry in instance network info cache for port f39516f4-121e-4ca9-9dca-3526ee4e078a. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:30:15 user nova-compute[70709]: DEBUG nova.network.neutron [req-0813b169-da76-422e-a278-8a94fa37714f req-0ab1a4e1-e780-44f9-9ec1-f1fb058048ec service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Updating instance_info_cache with network_info: [{"id": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "address": "fa:16:3e:e2:a4:78", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39516f4-12", "ovs_interfaceid": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:30:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0813b169-da76-422e-a278-8a94fa37714f req-0ab1a4e1-e780-44f9-9ec1-f1fb058048ec service nova] Releasing lock "refresh_cache-adea0906-40b1-4ebc-abe0-a4e24676c730" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:30:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG os_brick.utils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b7ea4e-f1ff-4bca-bb6f-e349653b25cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[00be6ddb-26a8-43b8-aca3-718310d8ef96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea47c59-6ba7-4c41-a18d-85b0e16bbdff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b294498-744e-4e92-a286-1660bde4a992]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:30:18 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c023f354-230d-41ec-a136-72459e3d165d]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG os_brick.utils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Updating existing volume attachment record: 35623b20-5b4a-4d58-ae52-6cf4683f785f {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:18 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284/disk --force-share --output=json" returned: 0 in 0.348s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:21 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504206.115171, b451d103-db00-4cea-86ed-d23cab6120f5 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:30:21 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] VM Stopped (Lifecycle Event)
Jul 28 00:30:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:30:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6bc48135-c593-4955-b7ef-f20521954a4e None None] [instance: b451d103-db00-4cea-86ed-d23cab6120f5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:30:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:30:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:30:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7553MB free_disk=25.08692169189453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:30:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance b61aaab4-ca86-41e6-a576-a7174d89a284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 773cf3d1-e98d-4002-bb1f-a3b33a36edac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 560f0547-6eb6-4009-87ba-8206a77c27e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance ef2b3139-5b7b-49e6-af46-10211f015b02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a7f9043f-80b2-4661-a43e-94e1f2816d7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance adea0906-40b1-4ebc-abe0-a4e24676c730 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:30:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.907s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:24 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:24 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:24 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:30:25 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:30:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Creating image(s)
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Ensure instance console log exists: /opt/stack/data/nova/instances/adea0906-40b1-4ebc-abe0-a4e24676c730/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Start _get_guest_xml network_info=[{"id": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "address": "fa:16:3e:e2:a4:78", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39516f4-12", "ovs_interfaceid": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '35623b20-5b4a-4d58-ae52-6cf4683f785f', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhXKPuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'adea0906-40b1-4ebc-abe0-a4e24676c730', 'attached_at': '', 'detached_at': '', 'volume_id': '57e0072e-2c11-409e-8177-ad08d8a37a13', 'serial': '57e0072e-2c11-409e-8177-ad08d8a37a13'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:30:26 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:30:26 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhXKPuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:30:26 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:30:26 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:30:26 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde4ff19-10e9-4577-a205-a60f87ea872d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:30:26 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d6792e-091c-452e-87e1-64c006d08e0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13] added
Jul 28 00:30:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c491bfa7-03b8-4a68-bb3b-4477bc516f07]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b62cd06-0044-42fe-a565-6b037ce89449]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhXKPuYO {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhXKPuYO" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdf9f51-09d3-478e-90a6-8e84983100b2]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VhXKPuYO'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5afca8-8c37-4c7b-b4e7-46bb29b15eb1]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db462c3-117c-4b02-8161-adcd04871044]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:30:26 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:30:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:30:26 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:30:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53fc8ff-9bad-42b3-85df-3bc70f5c2154]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13, portal: 172.16.0.220,3260]
Jul 28 00:30:26 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13, portal: 172.16.0.220,3260] successful.
Jul 28 00:30:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd12d6bf-2904-462e-a42e-6e187463db8f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d019de7-010f-4bde-beaa-8110ca88886f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:30:26 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:30:26 user nova-compute[70709]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 (non-flash)
Jul 28 00:30:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:30:26 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:30:26 user nova-compute[70709]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 (non-flash)
Jul 28 00:30:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[34088264-b39e-45a3-be70-16f7403bf20c]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhXKPuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:30:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23936653565653637', 'path': '/dev/sdc'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936653565653637', 'path': '/dev/sdc'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1966204106',display_name='tempest-TestVolumeBootPattern-server-1966204106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1966204106',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-dt3m3l1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:30:13Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=adea0906-40b1-4ebc-abe0-a4e24676c730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "address": "fa:16:3e:e2:a4:78", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39516f4-12", "ovs_interfaceid": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "address": "fa:16:3e:e2:a4:78", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39516f4-12", "ovs_interfaceid": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a4:78,bridge_name='br-int',has_traffic_filtering=True,id=f39516f4-121e-4ca9-9dca-3526ee4e078a,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39516f4-12') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG nova.objects.instance [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'pci_devices' on Instance uuid adea0906-40b1-4ebc-abe0-a4e24676c730 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:30:27 user nova-compute[70709]:   <uuid>adea0906-40b1-4ebc-abe0-a4e24676c730</uuid>
Jul 28 00:30:27 user nova-compute[70709]:   <name>instance-00000024</name>
Jul 28 00:30:27 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:30:27 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:30:27 user nova-compute[70709]:   <metadata>
Jul 28 00:30:27 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:30:27 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:30:27 user nova-compute[70709]:       <nova:name>tempest-TestVolumeBootPattern-server-1966204106</nova:name>
Jul 28 00:30:27 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:30:26</nova:creationTime>
Jul 28 00:30:27 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:30:27 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:30:27 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:30:27 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:30:27 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:30:27 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:30:27 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:30:27 user nova-compute[70709]:       <nova:owner>
Jul 28 00:30:27 user nova-compute[70709]:         <nova:user uuid="d994eb215f204b029d183b73539e3d4d">tempest-TestVolumeBootPattern-2090046407-project-member</nova:user>
Jul 28 00:30:27 user nova-compute[70709]:         <nova:project uuid="47d88e18679b4bc49c010b68ca813dab">tempest-TestVolumeBootPattern-2090046407</nova:project>
Jul 28 00:30:27 user nova-compute[70709]:       </nova:owner>
Jul 28 00:30:27 user nova-compute[70709]:       <nova:ports>
Jul 28 00:30:27 user nova-compute[70709]:         <nova:port uuid="f39516f4-121e-4ca9-9dca-3526ee4e078a">
Jul 28 00:30:27 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 28 00:30:27 user nova-compute[70709]:         </nova:port>
Jul 28 00:30:27 user nova-compute[70709]:       </nova:ports>
Jul 28 00:30:27 user nova-compute[70709]:     </nova:instance>
Jul 28 00:30:27 user nova-compute[70709]:   </metadata>
Jul 28 00:30:27 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:30:27 user nova-compute[70709]:     <system>
Jul 28 00:30:27 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:30:27 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:30:27 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:30:27 user nova-compute[70709]:       <entry name="serial">adea0906-40b1-4ebc-abe0-a4e24676c730</entry>
Jul 28 00:30:27 user nova-compute[70709]:       <entry name="uuid">adea0906-40b1-4ebc-abe0-a4e24676c730</entry>
Jul 28 00:30:27 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:30:27 user nova-compute[70709]:     </system>
Jul 28 00:30:27 user nova-compute[70709]:   </sysinfo>
Jul 28 00:30:27 user nova-compute[70709]:   <os>
Jul 28 00:30:27 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:30:27 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:30:27 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:30:27 user nova-compute[70709]:   </os>
Jul 28 00:30:27 user nova-compute[70709]:   <features>
Jul 28 00:30:27 user nova-compute[70709]:     <acpi/>
Jul 28 00:30:27 user nova-compute[70709]:     <apic/>
Jul 28 00:30:27 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:30:27 user nova-compute[70709]:   </features>
Jul 28 00:30:27 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:30:27 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:30:27 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:30:27 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:30:27 user nova-compute[70709]:   </clock>
Jul 28 00:30:27 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:30:27 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:30:27 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:30:27 user nova-compute[70709]:   </cpu>
Jul 28 00:30:27 user nova-compute[70709]:   <devices>
Jul 28 00:30:27 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:30:27 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:30:27 user nova-compute[70709]:       <source dev="/dev/sdc"/>
Jul 28 00:30:27 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:30:27 user nova-compute[70709]:       <serial>57e0072e-2c11-409e-8177-ad08d8a37a13</serial>
Jul 28 00:30:27 user nova-compute[70709]:     </disk>
Jul 28 00:30:27 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:30:27 user nova-compute[70709]:       <mac address="fa:16:3e:e2:a4:78"/>
Jul 28 00:30:27 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:30:27 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:30:27 user nova-compute[70709]:       <target dev="tapf39516f4-12"/>
Jul 28 00:30:27 user nova-compute[70709]:     </interface>
Jul 28 00:30:27 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:30:27 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/adea0906-40b1-4ebc-abe0-a4e24676c730/console.log" append="off"/>
Jul 28 00:30:27 user nova-compute[70709]:     </serial>
Jul 28 00:30:27 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:30:27 user nova-compute[70709]:     <video>
Jul 28 00:30:27 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:30:27 user nova-compute[70709]:     </video>
Jul 28 00:30:27 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:30:27 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:30:27 user nova-compute[70709]:     </rng>
Jul 28 00:30:27 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:30:27 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:30:27 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:30:27 user nova-compute[70709]:     </memballoon>
Jul 28 00:30:27 user nova-compute[70709]:   </devices>
Jul 28 00:30:27 user nova-compute[70709]: </domain>
Jul 28 00:30:27 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1966204106',display_name='tempest-TestVolumeBootPattern-server-1966204106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1966204106',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-dt3m3l1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:30:13Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=adea0906-40b1-4ebc-abe0-a4e24676c730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "address": "fa:16:3e:e2:a4:78", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39516f4-12", "ovs_interfaceid": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "address": "fa:16:3e:e2:a4:78", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39516f4-12", "ovs_interfaceid": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a4:78,bridge_name='br-int',has_traffic_filtering=True,id=f39516f4-121e-4ca9-9dca-3526ee4e078a,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39516f4-12') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG os_vif [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a4:78,bridge_name='br-int',has_traffic_filtering=True,id=f39516f4-121e-4ca9-9dca-3526ee4e078a,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39516f4-12') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf39516f4-12, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf39516f4-12, col_values=(('external_ids', {'iface-id': 'f39516f4-121e-4ca9-9dca-3526ee4e078a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:a4:78', 'vm-uuid': 'adea0906-40b1-4ebc-abe0-a4e24676c730'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:27 user nova-compute[70709]: INFO os_vif [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a4:78,bridge_name='br-int',has_traffic_filtering=True,id=f39516f4-121e-4ca9-9dca-3526ee4e078a,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39516f4-12')
Jul 28 00:30:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No VIF found with MAC fa:16:3e:e2:a4:78, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:30:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:28 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:28 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 00:30:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 00:30:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-ce88b2ef-dbb2-4dba-bac4-6f3689f02fb2 req-6a8fc722-288f-4b46-bf33-0d96ee3679b5 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Received event network-vif-plugged-f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ce88b2ef-dbb2-4dba-bac4-6f3689f02fb2 req-6a8fc722-288f-4b46-bf33-0d96ee3679b5 service nova] Acquiring lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ce88b2ef-dbb2-4dba-bac4-6f3689f02fb2 req-6a8fc722-288f-4b46-bf33-0d96ee3679b5 service nova] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ce88b2ef-dbb2-4dba-bac4-6f3689f02fb2 req-6a8fc722-288f-4b46-bf33-0d96ee3679b5 service nova] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-ce88b2ef-dbb2-4dba-bac4-6f3689f02fb2 req-6a8fc722-288f-4b46-bf33-0d96ee3679b5 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] No waiting events found dispatching network-vif-plugged-f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:30:29 user nova-compute[70709]: WARNING nova.compute.manager [req-ce88b2ef-dbb2-4dba-bac4-6f3689f02fb2 req-6a8fc722-288f-4b46-bf33-0d96ee3679b5 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Received unexpected event network-vif-plugged-f39516f4-121e-4ca9-9dca-3526ee4e078a for instance with vm_state building and task_state spawning.
Jul 28 00:30:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:30 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:30:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:30:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:30:30 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-9b7ca324-5e1c-41d8-b0f3-c78edcafabf4 req-2f2d4e09-ffa1-4f57-8e5a-62f56747c7b3 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Received event network-vif-plugged-f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9b7ca324-5e1c-41d8-b0f3-c78edcafabf4 req-2f2d4e09-ffa1-4f57-8e5a-62f56747c7b3 service nova] Acquiring lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9b7ca324-5e1c-41d8-b0f3-c78edcafabf4 req-2f2d4e09-ffa1-4f57-8e5a-62f56747c7b3 service nova] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9b7ca324-5e1c-41d8-b0f3-c78edcafabf4 req-2f2d4e09-ffa1-4f57-8e5a-62f56747c7b3 service nova] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.compute.manager [req-9b7ca324-5e1c-41d8-b0f3-c78edcafabf4 req-2f2d4e09-ffa1-4f57-8e5a-62f56747c7b3 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] No waiting events found dispatching network-vif-plugged-f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:30:31 user nova-compute[70709]: WARNING nova.compute.manager [req-9b7ca324-5e1c-41d8-b0f3-c78edcafabf4 req-2f2d4e09-ffa1-4f57-8e5a-62f56747c7b3 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Received unexpected event network-vif-plugged-f39516f4-121e-4ca9-9dca-3526ee4e078a for instance with vm_state building and task_state spawning.
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504231.3491595, adea0906-40b1-4ebc-abe0-a4e24676c730 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:30:31 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] VM Resumed (Lifecycle Event)
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:30:31 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Instance spawned successfully.
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:30:31 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504231.3533075, adea0906-40b1-4ebc-abe0-a4e24676c730 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:30:31 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] VM Started (Lifecycle Event)
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:30:31 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:30:31 user nova-compute[70709]: INFO nova.compute.manager [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Took 5.27 seconds to spawn the instance on the hypervisor.
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Updating instance_info_cache with network_info: [{"id": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "address": "fa:16:3e:be:80:57", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4589f8aa-27", "ovs_interfaceid": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:30:31 user nova-compute[70709]: INFO nova.compute.manager [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Took 19.63 seconds to build instance.
Jul 28 00:30:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-a7fa1bec-1d04-4634-90c7-9fcfb185580b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.714s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:31 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 39bc08e9-7b3c-4698-921e-429823996ce1 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 159a0ce2-f6b6-45bf-a743-74da642a79fe {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 773cf3d1-e98d-4002-bb1f-a3b33a36edac {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 560f0547-6eb6-4009-87ba-8206a77c27e8 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid ef2b3139-5b7b-49e6-af46-10211f015b02 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid a7f9043f-80b2-4661-a43e-94e1f2816d7a {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid adea0906-40b1-4ebc-abe0-a4e24676c730 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "39bc08e9-7b3c-4698-921e-429823996ce1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "39bc08e9-7b3c-4698-921e-429823996ce1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "ef2b3139-5b7b-49e6-af46-10211f015b02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "adea0906-40b1-4ebc-abe0-a4e24676c730" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "39bc08e9-7b3c-4698-921e-429823996ce1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:35 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:36 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:30:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:57 user nova-compute[70709]: INFO nova.compute.manager [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Terminating instance
Jul 28 00:30:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-af0468dd-9931-4f6c-ade1-b5d75ac10f5a req-0d7a562a-2e9d-45f5-8c2e-0b831e73d021 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-vif-unplugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-af0468dd-9931-4f6c-ade1-b5d75ac10f5a req-0d7a562a-2e9d-45f5-8c2e-0b831e73d021 service nova] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-af0468dd-9931-4f6c-ade1-b5d75ac10f5a req-0d7a562a-2e9d-45f5-8c2e-0b831e73d021 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-af0468dd-9931-4f6c-ade1-b5d75ac10f5a req-0d7a562a-2e9d-45f5-8c2e-0b831e73d021 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-af0468dd-9931-4f6c-ade1-b5d75ac10f5a req-0d7a562a-2e9d-45f5-8c2e-0b831e73d021 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] No waiting events found dispatching network-vif-unplugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:30:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-af0468dd-9931-4f6c-ade1-b5d75ac10f5a req-0d7a562a-2e9d-45f5-8c2e-0b831e73d021 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-vif-unplugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:30:58 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Instance destroyed successfully.
Jul 28 00:30:58 user nova-compute[70709]: DEBUG nova.objects.instance [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lazy-loading 'resources' on Instance uuid 560f0547-6eb6-4009-87ba-8206a77c27e8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:30:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1988638140',display_name='tempest-TestMinimumBasicScenario-server-1988638140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1988638140',id=29,image_ref='3622ee01-48a3-4e94-8d4d-a40d70322312',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgAe7fbR4SblP2yMACJUHdyDB7WJ1j0thr34aLr8igg2l4nxcVawVH0BIxYTgl6DqiQd59f4HFOlHBZSpkCvXZOiCWrZdx7GQ/FSRIs8EtMgBIdcVMjRCcMMwqAgTi1fw==',key_name='tempest-TestMinimumBasicScenario-719932542',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:26:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1de9e1809a584c68905d4c0f42302f8c',ramdisk_id='',reservation_id='r-u4bc4jc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3622ee01-48a3-4e94-8d4d-a40d70322312',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1435468286',owner_user_name='tempest-TestMinimumBasicScenario-1435468286-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:28:15Z,user_data=None,user_id='9ed7d89a57234f37b4c578669bce4cdb',uuid=560f0547-6eb6-4009-87ba-8206a77c27e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:30:58 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converting VIF {"id": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "address": "fa:16:3e:1e:53:55", "network": {"id": "c8ca09f9-dc02-40fc-b1c2-a9b621687286", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1658887565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1de9e1809a584c68905d4c0f42302f8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bd2d01-d6", "ovs_interfaceid": "e3bd2d01-d61d-4d30-a088-13f85c724ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:30:58 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:53:55,bridge_name='br-int',has_traffic_filtering=True,id=e3bd2d01-d61d-4d30-a088-13f85c724ce1,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bd2d01-d6') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:30:58 user nova-compute[70709]: DEBUG os_vif [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:53:55,bridge_name='br-int',has_traffic_filtering=True,id=e3bd2d01-d61d-4d30-a088-13f85c724ce1,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bd2d01-d6') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:30:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3bd2d01-d6, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:30:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:30:58 user nova-compute[70709]: INFO os_vif [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:53:55,bridge_name='br-int',has_traffic_filtering=True,id=e3bd2d01-d61d-4d30-a088-13f85c724ce1,network=Network(c8ca09f9-dc02-40fc-b1c2-a9b621687286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bd2d01-d6')
Jul 28 00:30:58 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Deleting instance files /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8_del
Jul 28 00:30:58 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Deletion of /opt/stack/data/nova/instances/560f0547-6eb6-4009-87ba-8206a77c27e8_del complete
Jul 28 00:30:58 user nova-compute[70709]: INFO nova.compute.manager [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 28 00:30:58 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:30:58 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:30:58 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-99a137fe-0e03-41b5-b3bf-812ff0a94f8b req-a9a57b0e-7d98-4416-a69d-d6fe215750bd service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-vif-deleted-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:30:59 user nova-compute[70709]: INFO nova.compute.manager [req-99a137fe-0e03-41b5-b3bf-812ff0a94f8b req-a9a57b0e-7d98-4416-a69d-d6fe215750bd service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Neutron deleted interface e3bd2d01-d61d-4d30-a088-13f85c724ce1; detaching it from the instance and deleting it from the info cache
Jul 28 00:30:59 user nova-compute[70709]: DEBUG nova.network.neutron [req-99a137fe-0e03-41b5-b3bf-812ff0a94f8b req-a9a57b0e-7d98-4416-a69d-d6fe215750bd service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:30:59 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Took 0.57 seconds to deallocate network for instance.
Jul 28 00:30:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-99a137fe-0e03-41b5-b3bf-812ff0a94f8b req-a9a57b0e-7d98-4416-a69d-d6fe215750bd service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Detach interface failed, port_id=e3bd2d01-d61d-4d30-a088-13f85c724ce1, reason: Instance 560f0547-6eb6-4009-87ba-8206a77c27e8 could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:30:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:30:59 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Deleted allocations for instance 560f0547-6eb6-4009-87ba-8206a77c27e8
Jul 28 00:30:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97149e17-6a85-4aa7-8c8e-b68d525801b9 tempest-TestMinimumBasicScenario-1435468286 tempest-TestMinimumBasicScenario-1435468286-project-member] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.073s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-cc055792-528d-4edd-8360-eca988eb93b7 req-4c02c06e-345d-452b-89e6-db4be896c5e6 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:31:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cc055792-528d-4edd-8360-eca988eb93b7 req-4c02c06e-345d-452b-89e6-db4be896c5e6 service nova] Acquiring lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cc055792-528d-4edd-8360-eca988eb93b7 req-4c02c06e-345d-452b-89e6-db4be896c5e6 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cc055792-528d-4edd-8360-eca988eb93b7 req-4c02c06e-345d-452b-89e6-db4be896c5e6 service nova] Lock "560f0547-6eb6-4009-87ba-8206a77c27e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-cc055792-528d-4edd-8360-eca988eb93b7 req-4c02c06e-345d-452b-89e6-db4be896c5e6 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] No waiting events found dispatching network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:31:00 user nova-compute[70709]: WARNING nova.compute.manager [req-cc055792-528d-4edd-8360-eca988eb93b7 req-4c02c06e-345d-452b-89e6-db4be896c5e6 service nova] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Received unexpected event network-vif-plugged-e3bd2d01-d61d-4d30-a088-13f85c724ce1 for instance with vm_state deleted and task_state None.
Jul 28 00:31:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:01 user nova-compute[70709]: INFO nova.compute.manager [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Terminating instance
Jul 28 00:31:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG nova.compute.manager [req-8ad8e910-aea7-49b6-9af9-42169a5debe3 req-cf03063a-a0aa-488b-8a27-858392c1089c service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-vif-unplugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8ad8e910-aea7-49b6-9af9-42169a5debe3 req-cf03063a-a0aa-488b-8a27-858392c1089c service nova] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8ad8e910-aea7-49b6-9af9-42169a5debe3 req-cf03063a-a0aa-488b-8a27-858392c1089c service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8ad8e910-aea7-49b6-9af9-42169a5debe3 req-cf03063a-a0aa-488b-8a27-858392c1089c service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG nova.compute.manager [req-8ad8e910-aea7-49b6-9af9-42169a5debe3 req-cf03063a-a0aa-488b-8a27-858392c1089c service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] No waiting events found dispatching network-vif-unplugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:31:01 user nova-compute[70709]: DEBUG nova.compute.manager [req-8ad8e910-aea7-49b6-9af9-42169a5debe3 req-cf03063a-a0aa-488b-8a27-858392c1089c service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-vif-unplugged-ee9a657a-7c7d-4849-8394-9438487032f9 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:31:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Instance destroyed successfully.
Jul 28 00:31:02 user nova-compute[70709]: DEBUG nova.objects.instance [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lazy-loading 'resources' on Instance uuid b61aaab4-ca86-41e6-a576-a7174d89a284 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T00:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1529008866',display_name='tempest-ServerActionsTestOtherA-server-1351361021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1529008866',id=2,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeSwvxc68f//yHU+rtReulTvrwXYqpttPMOCijEoL8Lvz3hnZmYDTxA5Gfrdoi+ssdnBFB/3jn48+ViAJIQ8KcEWXrne+m/ZB8W3ONY0Sb6Gm0MEXsMs7NEj3qL1yVNQw==',key_name='tempest-keypair-1062816476',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:18:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92ce75e559c74038919f88f186e35a17',ramdisk_id='',reservation_id='r-ekq6qgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-448184614',owner_user_name='tempest-ServerActionsTestOtherA-448184614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:18:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ba52cf0bd4f03ac0dfc73cc81b31d',uuid=b61aaab4-ca86-41e6-a576-a7174d89a284,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converting VIF {"id": "ee9a657a-7c7d-4849-8394-9438487032f9", "address": "fa:16:3e:4a:f3:cb", "network": {"id": "69a1074a-f3fd-4efb-ae62-e9d69ae4abf2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1418448163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce75e559c74038919f88f186e35a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9a657a-7c", "ovs_interfaceid": "ee9a657a-7c7d-4849-8394-9438487032f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG os_vif [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee9a657a-7c, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:02 user nova-compute[70709]: INFO os_vif [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f3:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee9a657a-7c7d-4849-8394-9438487032f9,network=Network(69a1074a-f3fd-4efb-ae62-e9d69ae4abf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9a657a-7c')
Jul 28 00:31:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Deleting instance files /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284_del
Jul 28 00:31:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Deletion of /opt/stack/data/nova/instances/b61aaab4-ca86-41e6-a576-a7174d89a284_del complete
Jul 28 00:31:02 user nova-compute[70709]: INFO nova.compute.manager [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Took 1.06 seconds to destroy the instance on the hypervisor.
Jul 28 00:31:02 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:31:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:03 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:31:03 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Took 0.65 seconds to deallocate network for instance.
Jul 28 00:31:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:03 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:31:03 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:31:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:03 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Deleted allocations for instance b61aaab4-ca86-41e6-a576-a7174d89a284
Jul 28 00:31:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-58a99919-925b-4e9b-9b45-255141eb43b6 tempest-ServerActionsTestOtherA-448184614 tempest-ServerActionsTestOtherA-448184614-project-member] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-89e93940-8242-4ee6-9171-f3736905cfc0 req-9b703584-770d-4f49-8b16-d111ba2d5c60 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:31:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-89e93940-8242-4ee6-9171-f3736905cfc0 req-9b703584-770d-4f49-8b16-d111ba2d5c60 service nova] Acquiring lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-89e93940-8242-4ee6-9171-f3736905cfc0 req-9b703584-770d-4f49-8b16-d111ba2d5c60 service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-89e93940-8242-4ee6-9171-f3736905cfc0 req-9b703584-770d-4f49-8b16-d111ba2d5c60 service nova] Lock "b61aaab4-ca86-41e6-a576-a7174d89a284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-89e93940-8242-4ee6-9171-f3736905cfc0 req-9b703584-770d-4f49-8b16-d111ba2d5c60 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] No waiting events found dispatching network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:31:03 user nova-compute[70709]: WARNING nova.compute.manager [req-89e93940-8242-4ee6-9171-f3736905cfc0 req-9b703584-770d-4f49-8b16-d111ba2d5c60 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received unexpected event network-vif-plugged-ee9a657a-7c7d-4849-8394-9438487032f9 for instance with vm_state deleted and task_state None.
Jul 28 00:31:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-89e93940-8242-4ee6-9171-f3736905cfc0 req-9b703584-770d-4f49-8b16-d111ba2d5c60 service nova] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Received event network-vif-deleted-ee9a657a-7c7d-4849-8394-9438487032f9 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:31:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:13 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504258.450134, 560f0547-6eb6-4009-87ba-8206a77c27e8 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:31:13 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] VM Stopped (Lifecycle Event)
Jul 28 00:31:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5bec9e46-b7cd-4cec-8760-9ca55e01529d None None] [instance: 560f0547-6eb6-4009-87ba-8206a77c27e8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:31:17 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504262.5254054, b61aaab4-ca86-41e6-a576-a7174d89a284 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:31:17 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] VM Stopped (Lifecycle Event)
Jul 28 00:31:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e59b2335-81c2-45e2-8af3-20c89486ba7c None None] [instance: b61aaab4-ca86-41e6-a576-a7174d89a284] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:31:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:31:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:31:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:31:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:31:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:31:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:31:20 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:31:20 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:31:20 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:31:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:31:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:22 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:31:22 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:31:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=7650MB free_disk=25.094257354736328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:31:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 773cf3d1-e98d-4002-bb1f-a3b33a36edac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance ef2b3139-5b7b-49e6-af46-10211f015b02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a7f9043f-80b2-4661-a43e-94e1f2816d7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance adea0906-40b1-4ebc-abe0-a4e24676c730 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:31:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:24 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:31:24 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:31:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:31:31 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:31:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:32 user nova-compute[70709]: INFO nova.compute.manager [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Terminating instance
Jul 28 00:31:32 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:31:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:31:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:31:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-773cf3d1-e98d-4002-bb1f-a3b33a36edac" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-773cf3d1-e98d-4002-bb1f-a3b33a36edac" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-41ed30ea-9d81-494f-9d02-03fb6c2aeca5 req-d410080e-57df-4ebf-8cca-5417f408d392 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-unplugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41ed30ea-9d81-494f-9d02-03fb6c2aeca5 req-d410080e-57df-4ebf-8cca-5417f408d392 service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41ed30ea-9d81-494f-9d02-03fb6c2aeca5 req-d410080e-57df-4ebf-8cca-5417f408d392 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41ed30ea-9d81-494f-9d02-03fb6c2aeca5 req-d410080e-57df-4ebf-8cca-5417f408d392 service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-41ed30ea-9d81-494f-9d02-03fb6c2aeca5 req-d410080e-57df-4ebf-8cca-5417f408d392 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-unplugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG nova.compute.manager [req-41ed30ea-9d81-494f-9d02-03fb6c2aeca5 req-d410080e-57df-4ebf-8cca-5417f408d392 service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-unplugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Updating instance_info_cache with network_info: [{"id": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "address": "fa:16:3e:d5:1b:29", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb6e5ed-40", "ovs_interfaceid": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-773cf3d1-e98d-4002-bb1f-a3b33a36edac" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:33 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Instance destroyed successfully.
Jul 28 00:31:33 user nova-compute[70709]: DEBUG nova.objects.instance [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'resources' on Instance uuid 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-547250233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-547250233',id=30,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:27:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-fhh06lyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:29:47Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=7f93835f-ae7f-430b-b30b-33a82ae6e2a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "address": "fa:16:3e:8a:25:5c", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b5fc91-86", "ovs_interfaceid": "24b5fc91-8612-423c-a94a-5759d0ad3cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:25:5c,bridge_name='br-int',has_traffic_filtering=True,id=24b5fc91-8612-423c-a94a-5759d0ad3cb2,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b5fc91-86') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG os_vif [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:25:5c,bridge_name='br-int',has_traffic_filtering=True,id=24b5fc91-8612-423c-a94a-5759d0ad3cb2,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b5fc91-86') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24b5fc91-86, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:31:33 user nova-compute[70709]: INFO os_vif [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:25:5c,bridge_name='br-int',has_traffic_filtering=True,id=24b5fc91-8612-423c-a94a-5759d0ad3cb2,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b5fc91-86')
Jul 28 00:31:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'compYVDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:31:33 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:31:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a43e71d-f287-41d8-8be6-b4872ad0ab46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:31:33 user nova-compute[70709]: No targets found.
Jul 28 00:31:33 user nova-compute[70709]: iSNS:
Jul 28 00:31:33 user nova-compute[70709]: No targets found.
Jul 28 00:31:33 user nova-compute[70709]: STATIC:
Jul 28 00:31:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13
Jul 28 00:31:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:31:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:31:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:31:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:31:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:31:33 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57
Jul 28 00:31:33 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:31:33 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:31:33 user nova-compute[70709]: FIRMWARE:
Jul 28 00:31:33 user nova-compute[70709]: No targets found.
Jul 28 00:31:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:31:33 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:31:33 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[609d61bf-76a8-4d31-9f40-870a22e266a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbcb4f6-9738-4430-a662-2709091575fd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:31:33 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:31:33 user nova-compute[70709]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 (non-flash)
Jul 28 00:31:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:31:33 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:31:33 user nova-compute[70709]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 (non-flash)
Jul 28 00:31:33 user nova-compute[70709]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 (non-flash)
Jul 28 00:31:33 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b88759c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57'): ({'sdd'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Removing single pathed devices sdd {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[746f4da7-e17d-4546-acd9-7e06f116a844]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cbbadd-1aba-48e3-ad5d-9cf6b94264ab]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flushing IO for device /dev/sdd {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fff5ec2-ad93-4c42-abde-09779a0fe3df]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0cb3af-3514-404c-90fc-510e21b8f936]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9598870a-9e7d3f4e8e87ed63', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9598870a', '/dev/disk/by-id/scsi-23965376433663465') {{(pid=82455) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d245f8-ffb6-4e68-9182-8534e52a666e]: (4, None) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e7e48c-da5e-421c-bf0d-b17a1334df66]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c17ed49-e382-42f3-95f4-d682199351d8]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57, portal: 172.16.0.220,3260]
Jul 28 00:31:34 user nova-compute[70709]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57, portal: 172.16.0.220,3260] successful.
Jul 28 00:31:34 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143be64f-f3a7-4b09-a61a-f6b0b30c7f57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9e91df-581e-483c-8c7f-708faec22aa2]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] <== disconnect_volume: return (338ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:31:34 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Deleting instance files /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2_del
Jul 28 00:31:34 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Deletion of /opt/stack/data/nova/instances/7f93835f-ae7f-430b-b30b-33a82ae6e2a2_del complete
Jul 28 00:31:34 user nova-compute[70709]: INFO nova.compute.manager [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Took 1.41 seconds to destroy the instance on the hypervisor.
Jul 28 00:31:34 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:31:34 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:31:35 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:31:35 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Took 0.89 seconds to deallocate network for instance.
Jul 28 00:31:35 user nova-compute[70709]: DEBUG nova.compute.manager [req-46bd9f48-7e26-49b6-a2ad-07d1cf05c5b6 req-644b9e2f-6b73-48d6-9bef-8666c3a95ebf service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:31:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-46bd9f48-7e26-49b6-a2ad-07d1cf05c5b6 req-644b9e2f-6b73-48d6-9bef-8666c3a95ebf service nova] Acquiring lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-46bd9f48-7e26-49b6-a2ad-07d1cf05c5b6 req-644b9e2f-6b73-48d6-9bef-8666c3a95ebf service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-46bd9f48-7e26-49b6-a2ad-07d1cf05c5b6 req-644b9e2f-6b73-48d6-9bef-8666c3a95ebf service nova] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:35 user nova-compute[70709]: DEBUG nova.compute.manager [req-46bd9f48-7e26-49b6-a2ad-07d1cf05c5b6 req-644b9e2f-6b73-48d6-9bef-8666c3a95ebf service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] No waiting events found dispatching network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:31:35 user nova-compute[70709]: WARNING nova.compute.manager [req-46bd9f48-7e26-49b6-a2ad-07d1cf05c5b6 req-644b9e2f-6b73-48d6-9bef-8666c3a95ebf service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received unexpected event network-vif-plugged-24b5fc91-8612-423c-a94a-5759d0ad3cb2 for instance with vm_state active and task_state deleting.
Jul 28 00:31:35 user nova-compute[70709]: DEBUG nova.compute.manager [req-46bd9f48-7e26-49b6-a2ad-07d1cf05c5b6 req-644b9e2f-6b73-48d6-9bef-8666c3a95ebf service nova] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Received event network-vif-deleted-24b5fc91-8612-423c-a94a-5759d0ad3cb2 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:31:35 user nova-compute[70709]: INFO nova.compute.manager [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Took 0.74 seconds to detach 1 volumes for instance.
Jul 28 00:31:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:36 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:31:36 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:31:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:36 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Deleted allocations for instance 7f93835f-ae7f-430b-b30b-33a82ae6e2a2
Jul 28 00:31:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-7d3bdc5e-d32c-4b0a-b36c-b6e1faefcca2 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "7f93835f-ae7f-430b-b30b-33a82ae6e2a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.771s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "ef2b3139-5b7b-49e6-af46-10211f015b02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:39 user nova-compute[70709]: INFO nova.compute.manager [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Terminating instance
Jul 28 00:31:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG nova.compute.manager [req-011d37eb-7128-4016-9914-6722d0a2440c req-8460d24a-f5de-48b2-8e29-753a7568a2e1 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Received event network-vif-unplugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-011d37eb-7128-4016-9914-6722d0a2440c req-8460d24a-f5de-48b2-8e29-753a7568a2e1 service nova] Acquiring lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-011d37eb-7128-4016-9914-6722d0a2440c req-8460d24a-f5de-48b2-8e29-753a7568a2e1 service nova] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-011d37eb-7128-4016-9914-6722d0a2440c req-8460d24a-f5de-48b2-8e29-753a7568a2e1 service nova] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG nova.compute.manager [req-011d37eb-7128-4016-9914-6722d0a2440c req-8460d24a-f5de-48b2-8e29-753a7568a2e1 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] No waiting events found dispatching network-vif-unplugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG nova.compute.manager [req-011d37eb-7128-4016-9914-6722d0a2440c req-8460d24a-f5de-48b2-8e29-753a7568a2e1 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Received event network-vif-unplugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:31:40 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Instance destroyed successfully.
Jul 28 00:31:40 user nova-compute[70709]: DEBUG nova.objects.instance [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lazy-loading 'resources' on Instance uuid ef2b3139-5b7b-49e6-af46-10211f015b02 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1882246927',display_name='tempest-VolumesActionsTest-instance-1882246927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1882246927',id=34,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='849c1603c3d6407fa7dafb0bef6af892',ramdisk_id='',reservation_id='r-11zjanei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-385116109',owner_user_name='tempest-VolumesActionsTest-385116109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:29:57Z,user_data=None,user_id='5740d1a26a6242db951f3283bed1c374',uuid=ef2b3139-5b7b-49e6-af46-10211f015b02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "address": "fa:16:3e:6c:19:d3", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf666dff5-5d", "ovs_interfaceid": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converting VIF {"id": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "address": "fa:16:3e:6c:19:d3", "network": {"id": "841ce7bd-8b05-4d3a-9a0d-42f53e33709b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1311462084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "849c1603c3d6407fa7dafb0bef6af892", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf666dff5-5d", "ovs_interfaceid": "f666dff5-5df4-40d4-a1bb-5c8604b148c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:19:d3,bridge_name='br-int',has_traffic_filtering=True,id=f666dff5-5df4-40d4-a1bb-5c8604b148c8,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf666dff5-5d') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG os_vif [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:19:d3,bridge_name='br-int',has_traffic_filtering=True,id=f666dff5-5df4-40d4-a1bb-5c8604b148c8,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf666dff5-5d') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf666dff5-5d, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:31:40 user nova-compute[70709]: INFO os_vif [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:19:d3,bridge_name='br-int',has_traffic_filtering=True,id=f666dff5-5df4-40d4-a1bb-5c8604b148c8,network=Network(841ce7bd-8b05-4d3a-9a0d-42f53e33709b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf666dff5-5d')
Jul 28 00:31:40 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Deleting instance files /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02_del
Jul 28 00:31:40 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Deletion of /opt/stack/data/nova/instances/ef2b3139-5b7b-49e6-af46-10211f015b02_del complete
Jul 28 00:31:40 user nova-compute[70709]: INFO nova.compute.manager [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 28 00:31:40 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:31:40 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:31:41 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:31:41 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Took 0.53 seconds to deallocate network for instance.
Jul 28 00:31:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:41 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:31:41 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:31:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:41 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Deleted allocations for instance ef2b3139-5b7b-49e6-af46-10211f015b02
Jul 28 00:31:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-fcdc23c6-b4f6-4251-9495-c464b192a9c2 tempest-VolumesActionsTest-385116109 tempest-VolumesActionsTest-385116109-project-member] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.675s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-0286917e-ae78-4cea-8e05-f279ba20aec2 req-c4d041ee-532a-4b5e-9140-01912415aef7 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Received event network-vif-plugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:31:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0286917e-ae78-4cea-8e05-f279ba20aec2 req-c4d041ee-532a-4b5e-9140-01912415aef7 service nova] Acquiring lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0286917e-ae78-4cea-8e05-f279ba20aec2 req-c4d041ee-532a-4b5e-9140-01912415aef7 service nova] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0286917e-ae78-4cea-8e05-f279ba20aec2 req-c4d041ee-532a-4b5e-9140-01912415aef7 service nova] Lock "ef2b3139-5b7b-49e6-af46-10211f015b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-0286917e-ae78-4cea-8e05-f279ba20aec2 req-c4d041ee-532a-4b5e-9140-01912415aef7 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] No waiting events found dispatching network-vif-plugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:31:42 user nova-compute[70709]: WARNING nova.compute.manager [req-0286917e-ae78-4cea-8e05-f279ba20aec2 req-c4d041ee-532a-4b5e-9140-01912415aef7 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Received unexpected event network-vif-plugged-f666dff5-5df4-40d4-a1bb-5c8604b148c8 for instance with vm_state deleted and task_state None.
Jul 28 00:31:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-0286917e-ae78-4cea-8e05-f279ba20aec2 req-c4d041ee-532a-4b5e-9140-01912415aef7 service nova] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Received event network-vif-deleted-f666dff5-5df4-40d4-a1bb-5c8604b148c8 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:31:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:48 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504293.8675392, 7f93835f-ae7f-430b-b30b-33a82ae6e2a2 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:31:48 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] VM Stopped (Lifecycle Event)
Jul 28 00:31:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-feb4ea4a-b042-40d0-bd1b-a1aa94f24b26 None None] [instance: 7f93835f-ae7f-430b-b30b-33a82ae6e2a2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:31:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-46cc4864-b670-4d44-8163-66a92af04c28 req-748990ac-fdc4-44ea-8a64-b40a24b603af service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Received event network-changed-c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:31:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-46cc4864-b670-4d44-8163-66a92af04c28 req-748990ac-fdc4-44ea-8a64-b40a24b603af service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Refreshing instance network info cache due to event network-changed-c5e74fc2-cd12-49a5-ae41-98730d5aebde. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:31:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-46cc4864-b670-4d44-8163-66a92af04c28 req-748990ac-fdc4-44ea-8a64-b40a24b603af service nova] Acquiring lock "refresh_cache-a7f9043f-80b2-4661-a43e-94e1f2816d7a" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:31:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-46cc4864-b670-4d44-8163-66a92af04c28 req-748990ac-fdc4-44ea-8a64-b40a24b603af service nova] Acquired lock "refresh_cache-a7f9043f-80b2-4661-a43e-94e1f2816d7a" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:31:54 user nova-compute[70709]: DEBUG nova.network.neutron [req-46cc4864-b670-4d44-8163-66a92af04c28 req-748990ac-fdc4-44ea-8a64-b40a24b603af service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Refreshing network info cache for port c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:31:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:54 user nova-compute[70709]: DEBUG nova.objects.instance [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'flavor' on Instance uuid a7f9043f-80b2-4661-a43e-94e1f2816d7a {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:31:54 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Ignoring supplied device name: /dev/vdb
Jul 28 00:31:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:31:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:31:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:31:54 user nova-compute[70709]: INFO nova.compute.manager [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Attaching volume f8b79eed-f886-40dd-804b-eabd6efac947 to /dev/vdb
Jul 28 00:31:55 user nova-compute[70709]: DEBUG os_brick.utils [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f281c21e-7014-4bb8-b569-54cb1ea81096]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c139de-d362-412d-a6b2-ce137e8bb175]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8267e7-b97d-4c4c-ad9a-ee2058cd45e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2073c88f-5404-4fbc-bf9e-49ec10793972]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:31:55 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c668ab-09dc-4e49-a847-0d46bbcc9211]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG os_brick.utils [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Updating existing volume attachment record: 6f4562e1-307a-485d-86bf-4afd74a98987 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG nova.network.neutron [req-46cc4864-b670-4d44-8163-66a92af04c28 req-748990ac-fdc4-44ea-8a64-b40a24b603af service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Updated VIF entry in instance network info cache for port c5e74fc2-cd12-49a5-ae41-98730d5aebde. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG nova.network.neutron [req-46cc4864-b670-4d44-8163-66a92af04c28 req-748990ac-fdc4-44ea-8a64-b40a24b603af service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Updating instance_info_cache with network_info: [{"id": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "address": "fa:16:3e:51:dd:d5", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e74fc2-cd", "ovs_interfaceid": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-46cc4864-b670-4d44-8163-66a92af04c28 req-748990ac-fdc4-44ea-8a64-b40a24b603af service nova] Releasing lock "refresh_cache-a7f9043f-80b2-4661-a43e-94e1f2816d7a" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504300.5503993, ef2b3139-5b7b-49e6-af46-10211f015b02 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:31:55 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] VM Stopped (Lifecycle Event)
Jul 28 00:31:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f810824f-1e52-442b-85ff-d6ff48ff9e09 None None] [instance: ef2b3139-5b7b-49e6-af46-10211f015b02] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:31:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:31:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "adea0906-40b1-4ebc-abe0-a4e24676c730" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:02 user nova-compute[70709]: INFO nova.compute.manager [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Terminating instance
Jul 28 00:32:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:32:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-53b17d98-b51d-4ae1-acfc-e50e476d849c req-f30d551f-45ef-4e8c-b8fa-5f5b37b8e378 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Received event network-vif-unplugged-f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-53b17d98-b51d-4ae1-acfc-e50e476d849c req-f30d551f-45ef-4e8c-b8fa-5f5b37b8e378 service nova] Acquiring lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-53b17d98-b51d-4ae1-acfc-e50e476d849c req-f30d551f-45ef-4e8c-b8fa-5f5b37b8e378 service nova] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-53b17d98-b51d-4ae1-acfc-e50e476d849c req-f30d551f-45ef-4e8c-b8fa-5f5b37b8e378 service nova] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-53b17d98-b51d-4ae1-acfc-e50e476d849c req-f30d551f-45ef-4e8c-b8fa-5f5b37b8e378 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] No waiting events found dispatching network-vif-unplugged-f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-53b17d98-b51d-4ae1-acfc-e50e476d849c req-f30d551f-45ef-4e8c-b8fa-5f5b37b8e378 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Received event network-vif-unplugged-f39516f4-121e-4ca9-9dca-3526ee4e078a for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:32:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Instance destroyed successfully.
Jul 28 00:32:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'resources' on Instance uuid adea0906-40b1-4ebc-abe0-a4e24676c730 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1966204106',display_name='tempest-TestVolumeBootPattern-server-1966204106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1966204106',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-dt3m3l1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:30:32Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=adea0906-40b1-4ebc-abe0-a4e24676c730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "address": "fa:16:3e:e2:a4:78", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39516f4-12", "ovs_interfaceid": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "address": "fa:16:3e:e2:a4:78", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39516f4-12", "ovs_interfaceid": "f39516f4-121e-4ca9-9dca-3526ee4e078a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a4:78,bridge_name='br-int',has_traffic_filtering=True,id=f39516f4-121e-4ca9-9dca-3526ee4e078a,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39516f4-12') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_vif [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a4:78,bridge_name='br-int',has_traffic_filtering=True,id=f39516f4-121e-4ca9-9dca-3526ee4e078a,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39516f4-12') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf39516f4-12, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:32:03 user nova-compute[70709]: INFO os_vif [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a4:78,bridge_name='br-int',has_traffic_filtering=True,id=f39516f4-121e-4ca9-9dca-3526ee4e078a,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39516f4-12')
Jul 28 00:32:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhXKPuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:32:03 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0989a9e9-75d3-4872-bc00-8bc185cd2d77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:32:03 user nova-compute[70709]: No targets found.
Jul 28 00:32:03 user nova-compute[70709]: iSNS:
Jul 28 00:32:03 user nova-compute[70709]: No targets found.
Jul 28 00:32:03 user nova-compute[70709]: STATIC:
Jul 28 00:32:03 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13
Jul 28 00:32:03 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:32:03 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:32:03 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:32:03 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:32:03 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:32:03 user nova-compute[70709]: FIRMWARE:
Jul 28 00:32:03 user nova-compute[70709]: No targets found.
Jul 28 00:32:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:32:03 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:32:03 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c110e4e-d27f-4630-92ba-122396120ab9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e94efd1-1d21-4cb7-a0b4-e6a0df6a852b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:32:03 user nova-compute[70709]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 (non-flash)
Jul 28 00:32:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:32:03 user nova-compute[70709]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 (non-flash)
Jul 28 00:32:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b9025b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13'): ({'sdc'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Removing single pathed devices sdc {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7993ee-f200-49ed-8274-046da2be80f0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ce9c3f-b252-4b43-9e20-93a47f463e5c]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flushing IO for device /dev/sdc {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf77dd7-8db8-4fae-b60c-d26607e28b75]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.115s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b812c5-ff08-44c6-bb99-9eac4a4cf1a4]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97ccae7-ea3e-4483-8fc6-8b58277180a4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd4301d-9817-4f49-898c-af5196e7d933]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13, portal: 172.16.0.220,3260]
Jul 28 00:32:03 user nova-compute[70709]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13, portal: 172.16.0.220,3260] successful.
Jul 28 00:32:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0072e-2c11-409e-8177-ad08d8a37a13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f298c35c-3096-495c-8b33-1938a16513b7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== disconnect_volume: return (384ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:32:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:32:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Deleting instance files /opt/stack/data/nova/instances/adea0906-40b1-4ebc-abe0-a4e24676c730_del
Jul 28 00:32:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Deletion of /opt/stack/data/nova/instances/adea0906-40b1-4ebc-abe0-a4e24676c730_del complete
Jul 28 00:32:04 user nova-compute[70709]: INFO nova.compute.manager [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Took 1.34 seconds to destroy the instance on the hypervisor.
Jul 28 00:32:04 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:32:04 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:32:04 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:32:04 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:32:04 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Took 0.77 seconds to deallocate network for instance.
Jul 28 00:32:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-8bb5a265-2fb7-4059-ac57-5ad5c6584a6d req-32c04174-b60f-4f8d-bc09-0951ba0a5d9e service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Received event network-vif-deleted-f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:32:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-60a0474a-2033-41be-bce5-bdf368ef494f req-1613c78c-b9a2-4040-ac65-86700f9b9012 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Received event network-vif-plugged-f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:32:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-60a0474a-2033-41be-bce5-bdf368ef494f req-1613c78c-b9a2-4040-ac65-86700f9b9012 service nova] Acquiring lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-60a0474a-2033-41be-bce5-bdf368ef494f req-1613c78c-b9a2-4040-ac65-86700f9b9012 service nova] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-60a0474a-2033-41be-bce5-bdf368ef494f req-1613c78c-b9a2-4040-ac65-86700f9b9012 service nova] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-60a0474a-2033-41be-bce5-bdf368ef494f req-1613c78c-b9a2-4040-ac65-86700f9b9012 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] No waiting events found dispatching network-vif-plugged-f39516f4-121e-4ca9-9dca-3526ee4e078a {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:32:05 user nova-compute[70709]: WARNING nova.compute.manager [req-60a0474a-2033-41be-bce5-bdf368ef494f req-1613c78c-b9a2-4040-ac65-86700f9b9012 service nova] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Received unexpected event network-vif-plugged-f39516f4-121e-4ca9-9dca-3526ee4e078a for instance with vm_state active and task_state deleting.
Jul 28 00:32:05 user nova-compute[70709]: INFO nova.compute.manager [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Took 0.80 seconds to detach 1 volumes for instance.
Jul 28 00:32:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Deleting volume: 57e0072e-2c11-409e-8177-ad08d8a37a13 {{(pid=70709) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 28 00:32:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:05 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:32:05 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:32:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:06 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Deleted allocations for instance adea0906-40b1-4ebc-abe0-a4e24676c730
Jul 28 00:32:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-13779d75-59ca-4776-a03b-35d91cf0d433 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "adea0906-40b1-4ebc-abe0-a4e24676c730" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.451s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pcyEjWts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:32:11 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:32:11 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:32:11 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b927853-12e0-4d2f-b052-ab49ffcef1f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:32:11 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7999d8-6967-4e49-8153-e744365169ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947] added
Jul 28 00:32:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e012de67-7f6d-4717-984a-c7b2a4d81605]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21edd09-3937-429e-a97a-247c73acead4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pcyEjWts {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pcyEjWts" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cce58c9-91c7-4d9b-94a2-3bf1efa113e4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pcyEjWts'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[501e280a-f861-4fef-9361-a702084804c7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f764218f-f99d-4ebc-8031-ba2aa4c1dc21]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:32:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:32:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfd9f20-623d-4511-87cf-182b1f41554f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947, portal: 172.16.0.220,3260]
Jul 28 00:32:11 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947, portal: 172.16.0.220,3260] successful.
Jul 28 00:32:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e68975-941d-4efe-93c3-91a6f67f026a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bae6d09-0579-4449-9ce3-60a5ef4318fe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:32:11 user nova-compute[70709]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 (non-flash)
Jul 28 00:32:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:32:11 user nova-compute[70709]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 (non-flash)
Jul 28 00:32:11 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2047176d-dbab-40f6-8208-010c70e4d2b9]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:32:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pcyEjWts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:32:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:32:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26238306435653931', 'path': '/dev/sdc'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:32:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238306435653931', 'path': '/dev/sdc'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:32:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'flavor' on Instance uuid a7f9043f-80b2-4661-a43e-94e1f2816d7a {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:32:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:32:12 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:32:12 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:32:12 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:32:12 user nova-compute[70709]:   <serial>f8b79eed-f886-40dd-804b-eabd6efac947</serial>
Jul 28 00:32:12 user nova-compute[70709]: </disk>
Jul 28 00:32:12 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:32:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:32:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:32:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] No VIF found with MAC fa:16:3e:51:dd:d5, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:32:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6983b77f-00d8-4414-be0d-fd2c087680a5 tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.330s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:18 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504323.4627852, adea0906-40b1-4ebc-abe0-a4e24676c730 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:32:18 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] VM Stopped (Lifecycle Event)
Jul 28 00:32:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f6ac9ddd-e64a-498b-a1aa-df825490977f None None] [instance: adea0906-40b1-4ebc-abe0-a4e24676c730] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:32:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:32:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:32:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:32:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:32:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:32:20 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:32:20 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:32:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:20 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:22 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:32:22 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:32:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8262MB free_disk=25.150264739990234GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 159a0ce2-f6b6-45bf-a743-74da642a79fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 773cf3d1-e98d-4002-bb1f-a3b33a36edac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance a7f9043f-80b2-4661-a43e-94e1f2816d7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:32:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:23 user nova-compute[70709]: INFO nova.compute.manager [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Terminating instance
Jul 28 00:32:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-f030f717-b335-4100-b93e-e819c7097c27 req-ace5ea02-3b49-4013-8a82-d5333e2190dc service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Received event network-vif-unplugged-4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f030f717-b335-4100-b93e-e819c7097c27 req-ace5ea02-3b49-4013-8a82-d5333e2190dc service nova] Acquiring lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f030f717-b335-4100-b93e-e819c7097c27 req-ace5ea02-3b49-4013-8a82-d5333e2190dc service nova] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f030f717-b335-4100-b93e-e819c7097c27 req-ace5ea02-3b49-4013-8a82-d5333e2190dc service nova] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-f030f717-b335-4100-b93e-e819c7097c27 req-ace5ea02-3b49-4013-8a82-d5333e2190dc service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] No waiting events found dispatching network-vif-unplugged-4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-f030f717-b335-4100-b93e-e819c7097c27 req-ace5ea02-3b49-4013-8a82-d5333e2190dc service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Received event network-vif-unplugged-4589f8aa-273e-4eef-8506-98fa4d45e56d for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:24 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Instance destroyed successfully.
Jul 28 00:32:24 user nova-compute[70709]: DEBUG nova.objects.instance [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'resources' on Instance uuid 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:32:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-197400054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-197400054',id=22,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-p4qw9gn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:24:57Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "address": "fa:16:3e:be:80:57", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4589f8aa-27", "ovs_interfaceid": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:32:24 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "address": "fa:16:3e:be:80:57", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4589f8aa-27", "ovs_interfaceid": "4589f8aa-273e-4eef-8506-98fa4d45e56d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:32:24 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:80:57,bridge_name='br-int',has_traffic_filtering=True,id=4589f8aa-273e-4eef-8506-98fa4d45e56d,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4589f8aa-27') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:32:24 user nova-compute[70709]: DEBUG os_vif [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:80:57,bridge_name='br-int',has_traffic_filtering=True,id=4589f8aa-273e-4eef-8506-98fa4d45e56d,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4589f8aa-27') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:32:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4589f8aa-27, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:32:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:32:24 user nova-compute[70709]: INFO os_vif [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:80:57,bridge_name='br-int',has_traffic_filtering=True,id=4589f8aa-273e-4eef-8506-98fa4d45e56d,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4589f8aa-27')
Jul 28 00:32:24 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Deleting instance files /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf_del
Jul 28 00:32:24 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Deletion of /opt/stack/data/nova/instances/1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf_del complete
Jul 28 00:32:24 user nova-compute[70709]: INFO nova.compute.manager [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 28 00:32:24 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:32:24 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:32:24 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:32:25 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Took 0.73 seconds to deallocate network for instance.
Jul 28 00:32:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:25 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Deleted allocations for instance 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf
Jul 28 00:32:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee15b5f1-a7c8-4f05-b717-4e931016102e tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.051s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-c1fcbf62-3fae-4c60-b4ca-33a1b58c4655 req-ab5f6781-7ec7-40cf-b8f5-ee329e3051a7 service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Received event network-vif-plugged-4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c1fcbf62-3fae-4c60-b4ca-33a1b58c4655 req-ab5f6781-7ec7-40cf-b8f5-ee329e3051a7 service nova] Acquiring lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c1fcbf62-3fae-4c60-b4ca-33a1b58c4655 req-ab5f6781-7ec7-40cf-b8f5-ee329e3051a7 service nova] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c1fcbf62-3fae-4c60-b4ca-33a1b58c4655 req-ab5f6781-7ec7-40cf-b8f5-ee329e3051a7 service nova] Lock "1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-c1fcbf62-3fae-4c60-b4ca-33a1b58c4655 req-ab5f6781-7ec7-40cf-b8f5-ee329e3051a7 service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] No waiting events found dispatching network-vif-plugged-4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:32:25 user nova-compute[70709]: WARNING nova.compute.manager [req-c1fcbf62-3fae-4c60-b4ca-33a1b58c4655 req-ab5f6781-7ec7-40cf-b8f5-ee329e3051a7 service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Received unexpected event network-vif-plugged-4589f8aa-273e-4eef-8506-98fa4d45e56d for instance with vm_state deleted and task_state None.
Jul 28 00:32:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-c1fcbf62-3fae-4c60-b4ca-33a1b58c4655 req-ab5f6781-7ec7-40cf-b8f5-ee329e3051a7 service nova] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Received event network-vif-deleted-4589f8aa-273e-4eef-8506-98fa4d45e56d {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:32:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:31 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:32:31 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:32:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:34 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:32:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:32:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:32:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:38 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:32:39 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504344.3741379, 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:32:39 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] VM Stopped (Lifecycle Event)
Jul 28 00:32:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4c0d3bfb-2117-45d1-8b40-f7816f5abadc None None] [instance: 1bed3f5b-7f8d-4bae-b8a2-77b581ef40cf] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:32:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:47 user nova-compute[70709]: INFO nova.compute.manager [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Detaching volume f8b79eed-f886-40dd-804b-eabd6efac947
Jul 28 00:32:47 user nova-compute[70709]: INFO nova.virt.block_device [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Attempting to driver detach volume f8b79eed-f886-40dd-804b-eabd6efac947 from mountpoint /dev/vdb
Jul 28 00:32:47 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Attempting to detach device vdb from instance a7f9043f-80b2-4661-a43e-94e1f2816d7a from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:32:47 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:32:47 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:32:47 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:32:47 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:32:47 user nova-compute[70709]:   <serial>f8b79eed-f886-40dd-804b-eabd6efac947</serial>
Jul 28 00:32:47 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:32:47 user nova-compute[70709]: </disk>
Jul 28 00:32:47 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:32:47 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Successfully detached device vdb from instance a7f9043f-80b2-4661-a43e-94e1f2816d7a from the persistent domain config.
Jul 28 00:32:47 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7f9043f-80b2-4661-a43e-94e1f2816d7a from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:32:47 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:32:47 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:32:47 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:32:47 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:32:47 user nova-compute[70709]:   <serial>f8b79eed-f886-40dd-804b-eabd6efac947</serial>
Jul 28 00:32:47 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:32:47 user nova-compute[70709]: </disk>
Jul 28 00:32:47 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:32:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504368.1640642, a7f9043f-80b2-4661-a43e-94e1f2816d7a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7f9043f-80b2-4661-a43e-94e1f2816d7a {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:32:48 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Successfully detached device vdb from instance a7f9043f-80b2-4661-a43e-94e1f2816d7a from the live domain config.
Jul 28 00:32:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pcyEjWts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:32:48 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.039s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[250dabb7-ee14-4473-9695-fb18b94d0aa4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:32:48 user nova-compute[70709]: No targets found.
Jul 28 00:32:48 user nova-compute[70709]: iSNS:
Jul 28 00:32:48 user nova-compute[70709]: No targets found.
Jul 28 00:32:48 user nova-compute[70709]: STATIC:
Jul 28 00:32:48 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9
Jul 28 00:32:48 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:32:48 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:32:48 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:32:48 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:32:48 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:32:48 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947
Jul 28 00:32:48 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:32:48 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:32:48 user nova-compute[70709]: FIRMWARE:
Jul 28 00:32:48 user nova-compute[70709]: No targets found.
Jul 28 00:32:48 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:32:48 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:32:48 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8bf30e-c47e-493b-9b6d-091e30bc7808]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3376f9c3-658f-41d8-a7b5-340cc51c3217]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:32:48 user nova-compute[70709]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 (non-flash)
Jul 28 00:32:48 user nova-compute[70709]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9 (non-flash)
Jul 28 00:32:48 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:32:48 user nova-compute[70709]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 (non-flash)
Jul 28 00:32:48 user nova-compute[70709]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9 (non-flash)
Jul 28 00:32:48 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90259360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947'): ({'sdc'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Removing single pathed devices sdc {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f7ade7-7d4c-4d32-a541-226fe492b59b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[883e572f-e0c4-4ab3-99cc-e541b57c90bb]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Flushing IO for device /dev/sdc {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8162316-12d0-4f5f-8a10-15221d389954]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[afac8b55-d2db-455f-9635-d6c8697776fb]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac0d57-1e7d-4ebc-a5ac-4cbaa14fd824]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d9dc32-7899-4a74-9e2f-0487de2e25bc]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947, portal: 172.16.0.220,3260]
Jul 28 00:32:48 user nova-compute[70709]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947, portal: 172.16.0.220,3260] successful.
Jul 28 00:32:48 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2956e3-e207-4385-b1d9-1287bf9acd47]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] <== disconnect_volume: return (400ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:32:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG nova.objects.instance [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'flavor' on Instance uuid a7f9043f-80b2-4661-a43e-94e1f2816d7a {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-25d9fb6b-ce52-437f-9946-ff268747351f tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.857s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.688s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:49 user nova-compute[70709]: INFO nova.compute.manager [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Terminating instance
Jul 28 00:32:49 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-ff6d76c9-8f87-4ba5-af62-ec67933629bf req-f1b57425-1fdd-4bde-a453-6ea0af2c5b18 service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Received event network-vif-unplugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ff6d76c9-8f87-4ba5-af62-ec67933629bf req-f1b57425-1fdd-4bde-a453-6ea0af2c5b18 service nova] Acquiring lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ff6d76c9-8f87-4ba5-af62-ec67933629bf req-f1b57425-1fdd-4bde-a453-6ea0af2c5b18 service nova] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ff6d76c9-8f87-4ba5-af62-ec67933629bf req-f1b57425-1fdd-4bde-a453-6ea0af2c5b18 service nova] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-ff6d76c9-8f87-4ba5-af62-ec67933629bf req-f1b57425-1fdd-4bde-a453-6ea0af2c5b18 service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] No waiting events found dispatching network-vif-unplugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:32:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-ff6d76c9-8f87-4ba5-af62-ec67933629bf req-f1b57425-1fdd-4bde-a453-6ea0af2c5b18 service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Received event network-vif-unplugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:50 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Instance destroyed successfully.
Jul 28 00:32:50 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lazy-loading 'resources' on Instance uuid a7f9043f-80b2-4661-a43e-94e1f2816d7a {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2070125239',display_name='tempest-VolumesSnapshotTestJSON-instance-2070125239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2070125239',id=35,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFVMPkO6iavJbOCGhRXbBl9zooNSOKHG7WItk0gZjKv5AbBFRAwQhmvgX9Z/Z1HGs/J396bI/Trpw22w3Eu4WvoZPuE9AT4/B9bgwKz7Kr4He2L2z/SJ5Hr1fRwXafEdA==',key_name='tempest-keypair-2137992995',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:30:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac4490eb04484a6c936f8268364f5458',ramdisk_id='',reservation_id='r-qt8yt90f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-720662141',owner_user_name='tempest-VolumesSnapshotTestJSON-720662141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce5a156400ad4eb5840168ab290161d1',uuid=a7f9043f-80b2-4661-a43e-94e1f2816d7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "address": "fa:16:3e:51:dd:d5", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e74fc2-cd", "ovs_interfaceid": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converting VIF {"id": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "address": "fa:16:3e:51:dd:d5", "network": {"id": "392f50ab-acff-46fa-9344-605a3379c9cc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1622780984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4490eb04484a6c936f8268364f5458", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e74fc2-cd", "ovs_interfaceid": "c5e74fc2-cd12-49a5-ae41-98730d5aebde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5e74fc2-cd12-49a5-ae41-98730d5aebde,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e74fc2-cd') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_vif [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5e74fc2-cd12-49a5-ae41-98730d5aebde,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e74fc2-cd') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5e74fc2-cd, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:32:50 user nova-compute[70709]: INFO os_vif [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5e74fc2-cd12-49a5-ae41-98730d5aebde,network=Network(392f50ab-acff-46fa-9344-605a3379c9cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e74fc2-cd')
Jul 28 00:32:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pcyEjWts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:32:50 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[089c68a1-3f4c-44f5-8e74-628625d26c20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:32:50 user nova-compute[70709]: No targets found.
Jul 28 00:32:50 user nova-compute[70709]: iSNS:
Jul 28 00:32:50 user nova-compute[70709]: No targets found.
Jul 28 00:32:50 user nova-compute[70709]: STATIC:
Jul 28 00:32:50 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9
Jul 28 00:32:50 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:32:50 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:32:50 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:32:50 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:32:50 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:32:50 user nova-compute[70709]: FIRMWARE:
Jul 28 00:32:50 user nova-compute[70709]: No targets found.
Jul 28 00:32:50 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:32:50 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:32:50 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8b79eed-f886-40dd-804b-eabd6efac947', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b894c662-0393-444a-8d50-2dc4fa3c6450]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd0cac0-322c-4b7e-94cb-eb8a170f40ed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:32:50 user nova-compute[70709]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9 (non-flash)
Jul 28 00:32:50 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:32:50 user nova-compute[70709]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd492960-ea9e-4e33-92a5-31eb08114ce9 (non-flash)
Jul 28 00:32:50 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b9d0b8dc0>, {}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Disconnecting from: [] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] <== disconnect_volume: return (86ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:32:50 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Deleting instance files /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a_del
Jul 28 00:32:50 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Deletion of /opt/stack/data/nova/instances/a7f9043f-80b2-4661-a43e-94e1f2816d7a_del complete
Jul 28 00:32:50 user nova-compute[70709]: INFO nova.compute.manager [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 28 00:32:50 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:32:50 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:32:51 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:32:51 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Took 1.01 seconds to deallocate network for instance.
Jul 28 00:32:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-09338d42-1045-4b6d-a7ee-a0f0d341c5e0 req-caa99314-0aac-423b-89fa-b72e2eb3c54f service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Received event network-vif-deleted-c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:32:51 user nova-compute[70709]: INFO nova.compute.manager [req-09338d42-1045-4b6d-a7ee-a0f0d341c5e0 req-caa99314-0aac-423b-89fa-b72e2eb3c54f service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Neutron deleted interface c5e74fc2-cd12-49a5-ae41-98730d5aebde; detaching it from the instance and deleting it from the info cache
Jul 28 00:32:51 user nova-compute[70709]: DEBUG nova.network.neutron [req-09338d42-1045-4b6d-a7ee-a0f0d341c5e0 req-caa99314-0aac-423b-89fa-b72e2eb3c54f service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:32:51 user nova-compute[70709]: WARNING nova.volume.cinder [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Attachment 6f4562e1-307a-485d-86bf-4afd74a98987 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6f4562e1-307a-485d-86bf-4afd74a98987. (HTTP 404) (Request-ID: req-b9f62512-ceb9-49cd-adc1-bc317800f5c7)
Jul 28 00:32:51 user nova-compute[70709]: INFO nova.compute.manager [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Took 0.03 seconds to detach 1 volumes for instance.
Jul 28 00:32:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-09338d42-1045-4b6d-a7ee-a0f0d341c5e0 req-caa99314-0aac-423b-89fa-b72e2eb3c54f service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Detach interface failed, port_id=c5e74fc2-cd12-49a5-ae41-98730d5aebde, reason: Instance a7f9043f-80b2-4661-a43e-94e1f2816d7a could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:32:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:51 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:32:51 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:32:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-5ea89eff-cd6a-41e2-9111-77e039acc9f5 req-c75f9388-1c8b-44fb-818f-4fd43972b25e service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Received event network-vif-plugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:32:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5ea89eff-cd6a-41e2-9111-77e039acc9f5 req-c75f9388-1c8b-44fb-818f-4fd43972b25e service nova] Acquiring lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:32:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5ea89eff-cd6a-41e2-9111-77e039acc9f5 req-c75f9388-1c8b-44fb-818f-4fd43972b25e service nova] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:32:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5ea89eff-cd6a-41e2-9111-77e039acc9f5 req-c75f9388-1c8b-44fb-818f-4fd43972b25e service nova] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-5ea89eff-cd6a-41e2-9111-77e039acc9f5 req-c75f9388-1c8b-44fb-818f-4fd43972b25e service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] No waiting events found dispatching network-vif-plugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:32:51 user nova-compute[70709]: WARNING nova.compute.manager [req-5ea89eff-cd6a-41e2-9111-77e039acc9f5 req-c75f9388-1c8b-44fb-818f-4fd43972b25e service nova] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Received unexpected event network-vif-plugged-c5e74fc2-cd12-49a5-ae41-98730d5aebde for instance with vm_state deleted and task_state None.
Jul 28 00:32:51 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Deleted allocations for instance a7f9043f-80b2-4661-a43e-94e1f2816d7a
Jul 28 00:32:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e5ce2ee7-929f-4893-957b-65f15257d4ea tempest-VolumesSnapshotTestJSON-720662141 tempest-VolumesSnapshotTestJSON-720662141-project-member] Lock "a7f9043f-80b2-4661-a43e-94e1f2816d7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.453s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:32:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:05 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504370.1884673, a7f9043f-80b2-4661-a43e-94e1f2816d7a => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:33:05 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] VM Stopped (Lifecycle Event)
Jul 28 00:33:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5eb05adc-7b25-4662-8af0-8d5d09b6a099 None None] [instance: a7f9043f-80b2-4661-a43e-94e1f2816d7a] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:33:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:33:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:33:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:33:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:33:12 user nova-compute[70709]: INFO nova.compute.claims [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Claim successful on node user
Jul 28 00:33:13 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG nova.network.neutron [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:33:13 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:33:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG nova.policy [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd994eb215f204b029d183b73539e3d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d88e18679b4bc49c010b68ca813dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:33:13 user nova-compute[70709]: INFO nova.virt.block_device [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Booting with volume 021bcf23-3b73-429e-a62e-a4eed2b753b6 at /dev/vda
Jul 28 00:33:13 user nova-compute[70709]: DEBUG os_brick.utils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ddecd5-76aa-417b-9d4d-935c0124ce80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[890652c3-9920-48fa-ad76-3acf708bcc43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e75896-5d83-41e1-934d-3892d1e32276]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7eedec-2a3f-481d-90e1-3d730695b454]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:33:13 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:33:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[397854c3-594b-4e62-94e6-1081f7987079]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG os_brick.utils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:33:13 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Updating existing volume attachment record: 0921a727-db9b-4a8f-996e-62bd17a68fad {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:14 user nova-compute[70709]: INFO nova.compute.manager [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Terminating instance
Jul 28 00:33:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Successfully created port: 83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:14 user nova-compute[70709]: INFO nova.compute.manager [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Terminating instance
Jul 28 00:33:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-306c6e6c-b7c0-44e3-825f-5f999d54dc02 req-297f7b75-c4a4-4a59-83d9-e877efcbdc89 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received event network-vif-unplugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-306c6e6c-b7c0-44e3-825f-5f999d54dc02 req-297f7b75-c4a4-4a59-83d9-e877efcbdc89 service nova] Acquiring lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-306c6e6c-b7c0-44e3-825f-5f999d54dc02 req-297f7b75-c4a4-4a59-83d9-e877efcbdc89 service nova] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-306c6e6c-b7c0-44e3-825f-5f999d54dc02 req-297f7b75-c4a4-4a59-83d9-e877efcbdc89 service nova] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-306c6e6c-b7c0-44e3-825f-5f999d54dc02 req-297f7b75-c4a4-4a59-83d9-e877efcbdc89 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] No waiting events found dispatching network-vif-unplugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-306c6e6c-b7c0-44e3-825f-5f999d54dc02 req-297f7b75-c4a4-4a59-83d9-e877efcbdc89 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received event network-vif-unplugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-c7d3cfdd-1388-44e5-9753-69169b458f06 req-7dc0d473-e462-4972-acec-f57ec29a3db1 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-unplugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c7d3cfdd-1388-44e5-9753-69169b458f06 req-7dc0d473-e462-4972-acec-f57ec29a3db1 service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c7d3cfdd-1388-44e5-9753-69169b458f06 req-7dc0d473-e462-4972-acec-f57ec29a3db1 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c7d3cfdd-1388-44e5-9753-69169b458f06 req-7dc0d473-e462-4972-acec-f57ec29a3db1 service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-c7d3cfdd-1388-44e5-9753-69169b458f06 req-7dc0d473-e462-4972-acec-f57ec29a3db1 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-unplugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-c7d3cfdd-1388-44e5-9753-69169b458f06 req-7dc0d473-e462-4972-acec-f57ec29a3db1 service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-unplugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:15 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Instance destroyed successfully.
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.objects.instance [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'resources' on Instance uuid 159a0ce2-f6b6-45bf-a743-74da642a79fe {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:33:15 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Instance destroyed successfully.
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.objects.instance [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lazy-loading 'resources' on Instance uuid 773cf3d1-e98d-4002-bb1f-a3b33a36edac {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1655245855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1655245855',id=14,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:19:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-0sw5nxth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:21:18Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=159a0ce2-f6b6-45bf-a743-74da642a79fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "address": "fa:16:3e:59:ff:6a", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc1adc03-97", "ovs_interfaceid": "bc1adc03-972b-4d2b-a9d6-94139d5726cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:ff:6a,bridge_name='br-int',has_traffic_filtering=True,id=bc1adc03-972b-4d2b-a9d6-94139d5726cc,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc1adc03-97') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_vif [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:ff:6a,bridge_name='br-int',has_traffic_filtering=True,id=bc1adc03-972b-4d2b-a9d6-94139d5726cc,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc1adc03-97') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-68901665',display_name='tempest-ServersNegativeTestJSON-server-68901665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-68901665',id=25,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c96d74828e1479381106c4c6538ea78',ramdisk_id='',reservation_id='r-gxuec1lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-969661376',owner_user_name='tempest-ServersNegativeTestJSON-969661376-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:24:28Z,user_data=None,user_id='3328a16a9f1f4311899b091ce8412ba5',uuid=773cf3d1-e98d-4002-bb1f-a3b33a36edac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "address": "fa:16:3e:d5:1b:29", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb6e5ed-40", "ovs_interfaceid": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converting VIF {"id": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "address": "fa:16:3e:d5:1b:29", "network": {"id": "a1f6d90d-83cc-44e9-9faa-cb7570564a82", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1802970360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c96d74828e1479381106c4c6538ea78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb6e5ed-40", "ovs_interfaceid": "4bb6e5ed-40d9-4724-b67c-9463bf00708f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=4bb6e5ed-40d9-4724-b67c-9463bf00708f,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb6e5ed-40') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_vif [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=4bb6e5ed-40d9-4724-b67c-9463bf00708f,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb6e5ed-40') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc1adc03-97, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bb6e5ed-40, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:33:15 user nova-compute[70709]: INFO os_vif [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:ff:6a,bridge_name='br-int',has_traffic_filtering=True,id=bc1adc03-972b-4d2b-a9d6-94139d5726cc,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc1adc03-97')
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fubBYVmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:33:15 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:33:15 user nova-compute[70709]: INFO os_vif [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=4bb6e5ed-40d9-4724-b67c-9463bf00708f,network=Network(a1f6d90d-83cc-44e9-9faa-cb7570564a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb6e5ed-40')
Jul 28 00:33:15 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Deleting instance files /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac_del
Jul 28 00:33:15 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Deletion of /opt/stack/data/nova/instances/773cf3d1-e98d-4002-bb1f-a3b33a36edac_del complete
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ec1d7d-10fc-4b34-8fc8-894a056a2693]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:33:15 user nova-compute[70709]: No targets found.
Jul 28 00:33:15 user nova-compute[70709]: iSNS:
Jul 28 00:33:15 user nova-compute[70709]: No targets found.
Jul 28 00:33:15 user nova-compute[70709]: STATIC:
Jul 28 00:33:15 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5
Jul 28 00:33:15 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:33:15 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:33:15 user nova-compute[70709]: FIRMWARE:
Jul 28 00:33:15 user nova-compute[70709]: No targets found.
Jul 28 00:33:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:33:15 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:33:15 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8b1dba-54f6-4ccb-a681-7d39f50eab46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[924165b6-b51f-4ecb-a9fb-54bce18c6ad8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:33:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 (non-flash)
Jul 28 00:33:15 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b8857f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5'): ({'sdb'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Removing single pathed devices sdb {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c898c2b-973d-4c29-b688-a218537cdcdc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:15 user nova-compute[70709]: INFO nova.compute.manager [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca27973-60f0-420a-b572-c40b4678c547]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Flushing IO for device /dev/sdb {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:33:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b49858-4e2b-4aaf-9f09-7386be8f5731]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae7ac0d-9316-4e57-86e2-09ebeb958bb0]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a18383-6db7-4518-83c6-21ff4f384da0]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ce9f4f-2ec1-4c52-a7b8-ce42eb62faed]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5, portal: 172.16.0.220,3260]
Jul 28 00:33:16 user nova-compute[70709]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5, portal: 172.16.0.220,3260] successful.
Jul 28 00:33:16 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a08c1c10-e7e4-4fae-a760-5bff01893ad5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[439fd200-766d-4d1c-9640-f879f84ea329]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] <== disconnect_volume: return (407ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:33:16 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Deleting instance files /opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe_del
Jul 28 00:33:16 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Deletion of /opt/stack/data/nova/instances/159a0ce2-f6b6-45bf-a743-74da642a79fe_del complete
Jul 28 00:33:16 user nova-compute[70709]: INFO nova.compute.manager [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Took 1.94 seconds to destroy the instance on the hypervisor.
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG nova.network.neutron [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Successfully updated port: 83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquired lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG nova.network.neutron [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-07a112f8-11bd-4b11-8ca1-09aa6db7599b req-d1870484-51fe-4031-8527-0229894351a0 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Received event network-changed-83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-07a112f8-11bd-4b11-8ca1-09aa6db7599b req-d1870484-51fe-4031-8527-0229894351a0 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Refreshing instance network info cache due to event network-changed-83039e8b-4639-43c6-a08d-48aeed4ee020. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-07a112f8-11bd-4b11-8ca1-09aa6db7599b req-d1870484-51fe-4031-8527-0229894351a0 service nova] Acquiring lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:33:16 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Took 0.96 seconds to deallocate network for instance.
Jul 28 00:33:16 user nova-compute[70709]: DEBUG nova.network.neutron [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received event network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] Acquiring lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] No waiting events found dispatching network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:33:17 user nova-compute[70709]: WARNING nova.compute.manager [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received unexpected event network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f for instance with vm_state deleted and task_state None.
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received event network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] Acquiring lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] No waiting events found dispatching network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:33:17 user nova-compute[70709]: WARNING nova.compute.manager [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received unexpected event network-vif-plugged-4bb6e5ed-40d9-4724-b67c-9463bf00708f for instance with vm_state deleted and task_state None.
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-63d12fa9-2b6d-4d3b-840f-26694f9d2b90 req-7b387a21-ef6f-412f-b1f9-070482d186b9 service nova] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Received event network-vif-deleted-4bb6e5ed-40d9-4724-b67c-9463bf00708f {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:33:17 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Deleted allocations for instance 773cf3d1-e98d-4002-bb1f-a3b33a36edac
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-9cbda2b3-443e-442c-94b3-bd0231f47826 req-b62a7841-f9c1-4114-b667-6a6a379d93cc service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9cbda2b3-443e-442c-94b3-bd0231f47826 req-b62a7841-f9c1-4114-b667-6a6a379d93cc service nova] Acquiring lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9cbda2b3-443e-442c-94b3-bd0231f47826 req-b62a7841-f9c1-4114-b667-6a6a379d93cc service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9cbda2b3-443e-442c-94b3-bd0231f47826 req-b62a7841-f9c1-4114-b667-6a6a379d93cc service nova] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-9cbda2b3-443e-442c-94b3-bd0231f47826 req-b62a7841-f9c1-4114-b667-6a6a379d93cc service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] No waiting events found dispatching network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:33:17 user nova-compute[70709]: WARNING nova.compute.manager [req-9cbda2b3-443e-442c-94b3-bd0231f47826 req-b62a7841-f9c1-4114-b667-6a6a379d93cc service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received unexpected event network-vif-plugged-bc1adc03-972b-4d2b-a9d6-94139d5726cc for instance with vm_state active and task_state deleting.
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.network.neutron [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Updating instance_info_cache with network_info: [{"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Releasing lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Instance network_info: |[{"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-07a112f8-11bd-4b11-8ca1-09aa6db7599b req-d1870484-51fe-4031-8527-0229894351a0 service nova] Acquired lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.network.neutron [req-07a112f8-11bd-4b11-8ca1-09aa6db7599b req-d1870484-51fe-4031-8527-0229894351a0 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Refreshing network info cache for port 83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:33:17 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Took 1.05 seconds to deallocate network for instance.
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-46c37123-2b82-4db5-b00b-14f8191cddde tempest-ServersNegativeTestJSON-969661376 tempest-ServersNegativeTestJSON-969661376-project-member] Lock "773cf3d1-e98d-4002-bb1f-a3b33a36edac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.633s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.network.neutron [req-07a112f8-11bd-4b11-8ca1-09aa6db7599b req-d1870484-51fe-4031-8527-0229894351a0 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Updated VIF entry in instance network info cache for port 83039e8b-4639-43c6-a08d-48aeed4ee020. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG nova.network.neutron [req-07a112f8-11bd-4b11-8ca1-09aa6db7599b req-d1870484-51fe-4031-8527-0229894351a0 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Updating instance_info_cache with network_info: [{"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:33:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-07a112f8-11bd-4b11-8ca1-09aa6db7599b req-d1870484-51fe-4031-8527-0229894351a0 service nova] Releasing lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:33:18 user nova-compute[70709]: INFO nova.compute.manager [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Took 0.77 seconds to detach 1 volumes for instance.
Jul 28 00:33:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:18 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:33:18 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:33:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:18 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Deleted allocations for instance 159a0ce2-f6b6-45bf-a743-74da642a79fe
Jul 28 00:33:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9a394dd-b212-489d-aee4-f8d7d7954d14 tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "159a0ce2-f6b6-45bf-a743-74da642a79fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.154s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:33:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-573b51b4-cd23-4fda-b4ab-8e025d462059 req-3f318048-e106-4b7b-9b35-257f54619d7f service nova] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Received event network-vif-deleted-bc1adc03-972b-4d2b-a9d6-94139d5726cc {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:33:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:33:21 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Creating image(s)
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Ensure instance console log exists: /opt/stack/data/nova/instances/aeb18468-b813-42ff-9f27-9fc3bab1aaf2/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Start _get_guest_xml network_info=[{"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '0921a727-db9b-4a8f-996e-62bd17a68fad', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlaKFbWw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aeb18468-b813-42ff-9f27-9fc3bab1aaf2', 'attached_at': '', 'detached_at': '', 'volume_id': '021bcf23-3b73-429e-a62e-a4eed2b753b6', 'serial': '021bcf23-3b73-429e-a62e-a4eed2b753b6'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:33:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:33:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlaKFbWw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:33:21 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:33:21 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:33:21 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3fc794-368e-43c1-bb75-7e77875968be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:33:21 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be8540c-a192-4743-90e3-907dd55c46cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6] added
Jul 28 00:33:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[da27eb63-b290-46aa-b554-f86ec941faed]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b429e2-9594-4c2d-aa65-3ddd752cdf6e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlaKFbWw {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlaKFbWw" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[054b2134-6bca-4d5d-af63-eb2fb91f4e1c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BlaKFbWw'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23f7271-bbfa-4870-bd5a-385139ffdb10]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d03c5ea-dd23-4206-9519-87a51bbfeb46]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 28 00:33:21 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 28 00:33:21 user nova-compute[70709]:  {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:33:21 user nova-compute[70709]: WARNING os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 28 00:33:21 user nova-compute[70709]: 
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2d9409-bd2b-4423-bb0b-ae0a4356add6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6, portal: 172.16.0.220,3260]
Jul 28 00:33:21 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6, portal: 172.16.0.220,3260] successful.
Jul 28 00:33:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cd3d20-450f-4468-a1e2-e3fa77b113d9]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c245293b-230c-48ee-a9cb-ec71c3d35e63]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:33:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:33:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0329ac5-8670-4741-964e-b0c649b2c2ec]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlaKFbWw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:33:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23235373233343231', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235373233343231', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:33:22 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:33:22 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=25.31826400756836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1132786539',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1132786539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1132786539',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdl4Pp34RLDG/jg5LNDI7/Jpa5ECOu+z8qiltCBcAvgapoF46H2W6vdbz5cSO7Og9HM7ERRIAIEiHww8Bi/TLvvywF/0uucycIEW3qcCvZ7yfABTIO63OO7JOnVV/yZlQ==',key_name='tempest-keypair-1530777911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-wu610k7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:33:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d994eb215f204b029d183b73539e3d4d',uuid=aeb18468-b813-42ff-9f27-9fc3bab1aaf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=83039e8b-4639-43c6-a08d-48aeed4ee020,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83039e8b-46') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.objects.instance [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'pci_devices' on Instance uuid aeb18468-b813-42ff-9f27-9fc3bab1aaf2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:33:22 user nova-compute[70709]:   <uuid>aeb18468-b813-42ff-9f27-9fc3bab1aaf2</uuid>
Jul 28 00:33:22 user nova-compute[70709]:   <name>instance-00000025</name>
Jul 28 00:33:22 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:33:22 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:33:22 user nova-compute[70709]:   <metadata>
Jul 28 00:33:22 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:33:22 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:33:22 user nova-compute[70709]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1132786539</nova:name>
Jul 28 00:33:22 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:33:21</nova:creationTime>
Jul 28 00:33:22 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:33:22 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:33:22 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:33:22 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:33:22 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:33:22 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:33:22 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:33:22 user nova-compute[70709]:       <nova:owner>
Jul 28 00:33:22 user nova-compute[70709]:         <nova:user uuid="d994eb215f204b029d183b73539e3d4d">tempest-TestVolumeBootPattern-2090046407-project-member</nova:user>
Jul 28 00:33:22 user nova-compute[70709]:         <nova:project uuid="47d88e18679b4bc49c010b68ca813dab">tempest-TestVolumeBootPattern-2090046407</nova:project>
Jul 28 00:33:22 user nova-compute[70709]:       </nova:owner>
Jul 28 00:33:22 user nova-compute[70709]:       <nova:ports>
Jul 28 00:33:22 user nova-compute[70709]:         <nova:port uuid="83039e8b-4639-43c6-a08d-48aeed4ee020">
Jul 28 00:33:22 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 28 00:33:22 user nova-compute[70709]:         </nova:port>
Jul 28 00:33:22 user nova-compute[70709]:       </nova:ports>
Jul 28 00:33:22 user nova-compute[70709]:     </nova:instance>
Jul 28 00:33:22 user nova-compute[70709]:   </metadata>
Jul 28 00:33:22 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:33:22 user nova-compute[70709]:     <system>
Jul 28 00:33:22 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:33:22 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:33:22 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:33:22 user nova-compute[70709]:       <entry name="serial">aeb18468-b813-42ff-9f27-9fc3bab1aaf2</entry>
Jul 28 00:33:22 user nova-compute[70709]:       <entry name="uuid">aeb18468-b813-42ff-9f27-9fc3bab1aaf2</entry>
Jul 28 00:33:22 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:33:22 user nova-compute[70709]:     </system>
Jul 28 00:33:22 user nova-compute[70709]:   </sysinfo>
Jul 28 00:33:22 user nova-compute[70709]:   <os>
Jul 28 00:33:22 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:33:22 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:33:22 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:33:22 user nova-compute[70709]:   </os>
Jul 28 00:33:22 user nova-compute[70709]:   <features>
Jul 28 00:33:22 user nova-compute[70709]:     <acpi/>
Jul 28 00:33:22 user nova-compute[70709]:     <apic/>
Jul 28 00:33:22 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:33:22 user nova-compute[70709]:   </features>
Jul 28 00:33:22 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:33:22 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:33:22 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:33:22 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:33:22 user nova-compute[70709]:   </clock>
Jul 28 00:33:22 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:33:22 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:33:22 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:33:22 user nova-compute[70709]:   </cpu>
Jul 28 00:33:22 user nova-compute[70709]:   <devices>
Jul 28 00:33:22 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:33:22 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:33:22 user nova-compute[70709]:       <source dev="/dev/sdb"/>
Jul 28 00:33:22 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:33:22 user nova-compute[70709]:       <serial>021bcf23-3b73-429e-a62e-a4eed2b753b6</serial>
Jul 28 00:33:22 user nova-compute[70709]:     </disk>
Jul 28 00:33:22 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:33:22 user nova-compute[70709]:       <mac address="fa:16:3e:ad:6a:f1"/>
Jul 28 00:33:22 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:33:22 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:33:22 user nova-compute[70709]:       <target dev="tap83039e8b-46"/>
Jul 28 00:33:22 user nova-compute[70709]:     </interface>
Jul 28 00:33:22 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:33:22 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/aeb18468-b813-42ff-9f27-9fc3bab1aaf2/console.log" append="off"/>
Jul 28 00:33:22 user nova-compute[70709]:     </serial>
Jul 28 00:33:22 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:33:22 user nova-compute[70709]:     <video>
Jul 28 00:33:22 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:33:22 user nova-compute[70709]:     </video>
Jul 28 00:33:22 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:33:22 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:33:22 user nova-compute[70709]:     </rng>
Jul 28 00:33:22 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:33:22 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:33:22 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:33:22 user nova-compute[70709]:     </memballoon>
Jul 28 00:33:22 user nova-compute[70709]:   </devices>
Jul 28 00:33:22 user nova-compute[70709]: </domain>
Jul 28 00:33:22 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1132786539',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1132786539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1132786539',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdl4Pp34RLDG/jg5LNDI7/Jpa5ECOu+z8qiltCBcAvgapoF46H2W6vdbz5cSO7Og9HM7ERRIAIEiHww8Bi/TLvvywF/0uucycIEW3qcCvZ7yfABTIO63OO7JOnVV/yZlQ==',key_name='tempest-keypair-1530777911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-wu610k7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:33:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d994eb215f204b029d183b73539e3d4d',uuid=aeb18468-b813-42ff-9f27-9fc3bab1aaf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=83039e8b-4639-43c6-a08d-48aeed4ee020,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83039e8b-46') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG os_vif [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=83039e8b-4639-43c6-a08d-48aeed4ee020,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83039e8b-46') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83039e8b-46, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83039e8b-46, col_values=(('external_ids', {'iface-id': '83039e8b-4639-43c6-a08d-48aeed4ee020', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:6a:f1', 'vm-uuid': 'aeb18468-b813-42ff-9f27-9fc3bab1aaf2'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:33:22 user nova-compute[70709]: INFO os_vif [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=83039e8b-4639-43c6-a08d-48aeed4ee020,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83039e8b-46')
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 39bc08e9-7b3c-4698-921e-429823996ce1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance aeb18468-b813-42ff-9f27-9fc3bab1aaf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No VIF found with MAC fa:16:3e:ad:6a:f1, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:33:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:33:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:33:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:33:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:33:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:24 user nova-compute[70709]: DEBUG nova.compute.manager [req-e068f2fa-d07e-4a17-891e-19506b8f4e15 req-e5b19bd9-be71-442c-bb1e-75ca89e6c36f service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Received event network-vif-plugged-83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:33:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e068f2fa-d07e-4a17-891e-19506b8f4e15 req-e5b19bd9-be71-442c-bb1e-75ca89e6c36f service nova] Acquiring lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e068f2fa-d07e-4a17-891e-19506b8f4e15 req-e5b19bd9-be71-442c-bb1e-75ca89e6c36f service nova] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e068f2fa-d07e-4a17-891e-19506b8f4e15 req-e5b19bd9-be71-442c-bb1e-75ca89e6c36f service nova] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:24 user nova-compute[70709]: DEBUG nova.compute.manager [req-e068f2fa-d07e-4a17-891e-19506b8f4e15 req-e5b19bd9-be71-442c-bb1e-75ca89e6c36f service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] No waiting events found dispatching network-vif-plugged-83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:33:24 user nova-compute[70709]: WARNING nova.compute.manager [req-e068f2fa-d07e-4a17-891e-19506b8f4e15 req-e5b19bd9-be71-442c-bb1e-75ca89e6c36f service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Received unexpected event network-vif-plugged-83039e8b-4639-43c6-a08d-48aeed4ee020 for instance with vm_state building and task_state spawning.
Jul 28 00:33:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:25 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504406.3428812, aeb18468-b813-42ff-9f27-9fc3bab1aaf2 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:33:26 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] VM Resumed (Lifecycle Event)
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:33:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Instance spawned successfully.
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:33:26 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504406.344139, aeb18468-b813-42ff-9f27-9fc3bab1aaf2 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:33:26 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] VM Started (Lifecycle Event)
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.compute.manager [req-776e2134-8aa4-4590-a9e7-2313a71e26b6 req-2ab65851-aa42-4e93-a52d-c18d0eb7122d service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Received event network-vif-plugged-83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-776e2134-8aa4-4590-a9e7-2313a71e26b6 req-2ab65851-aa42-4e93-a52d-c18d0eb7122d service nova] Acquiring lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-776e2134-8aa4-4590-a9e7-2313a71e26b6 req-2ab65851-aa42-4e93-a52d-c18d0eb7122d service nova] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-776e2134-8aa4-4590-a9e7-2313a71e26b6 req-2ab65851-aa42-4e93-a52d-c18d0eb7122d service nova] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.compute.manager [req-776e2134-8aa4-4590-a9e7-2313a71e26b6 req-2ab65851-aa42-4e93-a52d-c18d0eb7122d service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] No waiting events found dispatching network-vif-plugged-83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:33:26 user nova-compute[70709]: WARNING nova.compute.manager [req-776e2134-8aa4-4590-a9e7-2313a71e26b6 req-2ab65851-aa42-4e93-a52d-c18d0eb7122d service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Received unexpected event network-vif-plugged-83039e8b-4639-43c6-a08d-48aeed4ee020 for instance with vm_state building and task_state spawning.
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:33:26 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:33:26 user nova-compute[70709]: INFO nova.compute.manager [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Took 5.25 seconds to spawn the instance on the hypervisor.
Jul 28 00:33:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:33:26 user nova-compute[70709]: INFO nova.compute.manager [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Took 13.75 seconds to build instance.
Jul 28 00:33:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-eb0de4cb-8d61-4087-91cf-1fa66b26edad tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.837s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:33:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:30 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504395.6633477, 159a0ce2-f6b6-45bf-a743-74da642a79fe => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:33:30 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] VM Stopped (Lifecycle Event)
Jul 28 00:33:30 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504395.680489, 773cf3d1-e98d-4002-bb1f-a3b33a36edac => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:33:30 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] VM Stopped (Lifecycle Event)
Jul 28 00:33:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-68115e31-3c0a-4524-bd6a-2377d63c3c39 None None] [instance: 773cf3d1-e98d-4002-bb1f-a3b33a36edac] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:33:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-43437d9e-b4ed-4023-ae08-4400d26837f9 None None] [instance: 159a0ce2-f6b6-45bf-a743-74da642a79fe] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:33:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:33:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:33:36 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:33:36 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:33:36 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:33:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:33:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:33:36 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:33:36 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 39bc08e9-7b3c-4698-921e-429823996ce1 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:33:37 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updating instance_info_cache with network_info: [{"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:33:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-39bc08e9-7b3c-4698-921e-429823996ce1" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:33:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:33:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:33:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:33:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:33:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:33:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:33:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:33:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:33:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:33:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:33:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:33:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "39bc08e9-7b3c-4698-921e-429823996ce1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "39bc08e9-7b3c-4698-921e-429823996ce1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:05 user nova-compute[70709]: INFO nova.compute.manager [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Terminating instance
Jul 28 00:34:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-659b967a-ebe7-4c6e-b075-ecc60ed63261 req-a8dcddfc-0c0b-4425-afa7-0fdab9b91eae service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Received event network-vif-unplugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-659b967a-ebe7-4c6e-b075-ecc60ed63261 req-a8dcddfc-0c0b-4425-afa7-0fdab9b91eae service nova] Acquiring lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-659b967a-ebe7-4c6e-b075-ecc60ed63261 req-a8dcddfc-0c0b-4425-afa7-0fdab9b91eae service nova] Lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-659b967a-ebe7-4c6e-b075-ecc60ed63261 req-a8dcddfc-0c0b-4425-afa7-0fdab9b91eae service nova] Lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-659b967a-ebe7-4c6e-b075-ecc60ed63261 req-a8dcddfc-0c0b-4425-afa7-0fdab9b91eae service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] No waiting events found dispatching network-vif-unplugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-659b967a-ebe7-4c6e-b075-ecc60ed63261 req-a8dcddfc-0c0b-4425-afa7-0fdab9b91eae service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Received event network-vif-unplugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Instance destroyed successfully.
Jul 28 00:34:06 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lazy-loading 'resources' on Instance uuid 39bc08e9-7b3c-4698-921e-429823996ce1 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-280297558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-280297558',id=5,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6929fa5cb2284dd8b94c387bf6e3fef6',ramdisk_id='',reservation_id='r-19x73pet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:16:23Z,user_data=None,user_id='fa22ce59fc4742d4ab16292a8b3d6e3f',uuid=39bc08e9-7b3c-4698-921e-429823996ce1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converting VIF {"id": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "address": "fa:16:3e:92:f2:43", "network": {"id": "ac9c1639-6fb8-4315-a480-352152cfc167", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-6119121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6929fa5cb2284dd8b94c387bf6e3fef6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42dd3fcb-61", "ovs_interfaceid": "42dd3fcb-611d-4f7f-ad9e-f3862e010c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=42dd3fcb-611d-4f7f-ad9e-f3862e010c66,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42dd3fcb-61') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG os_vif [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=42dd3fcb-611d-4f7f-ad9e-f3862e010c66,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42dd3fcb-61') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42dd3fcb-61, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:34:06 user nova-compute[70709]: INFO os_vif [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=42dd3fcb-611d-4f7f-ad9e-f3862e010c66,network=Network(ac9c1639-6fb8-4315-a480-352152cfc167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42dd3fcb-61')
Jul 28 00:34:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Deleting instance files /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1_del
Jul 28 00:34:06 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Deletion of /opt/stack/data/nova/instances/39bc08e9-7b3c-4698-921e-429823996ce1_del complete
Jul 28 00:34:06 user nova-compute[70709]: INFO nova.compute.manager [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Took 0.97 seconds to destroy the instance on the hypervisor.
Jul 28 00:34:06 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:34:06 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:34:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-2fd8e38d-8c73-47fb-b870-b6766fce18f6 req-9cee6c2a-8808-4e70-b41c-130b19fd2ea9 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Received event network-vif-plugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:34:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2fd8e38d-8c73-47fb-b870-b6766fce18f6 req-9cee6c2a-8808-4e70-b41c-130b19fd2ea9 service nova] Acquiring lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2fd8e38d-8c73-47fb-b870-b6766fce18f6 req-9cee6c2a-8808-4e70-b41c-130b19fd2ea9 service nova] Lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2fd8e38d-8c73-47fb-b870-b6766fce18f6 req-9cee6c2a-8808-4e70-b41c-130b19fd2ea9 service nova] Lock "39bc08e9-7b3c-4698-921e-429823996ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-2fd8e38d-8c73-47fb-b870-b6766fce18f6 req-9cee6c2a-8808-4e70-b41c-130b19fd2ea9 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] No waiting events found dispatching network-vif-plugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:34:08 user nova-compute[70709]: WARNING nova.compute.manager [req-2fd8e38d-8c73-47fb-b870-b6766fce18f6 req-9cee6c2a-8808-4e70-b41c-130b19fd2ea9 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Received unexpected event network-vif-plugged-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 for instance with vm_state active and task_state deleting.
Jul 28 00:34:08 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:34:08 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Took 1.77 seconds to deallocate network for instance.
Jul 28 00:34:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-6d99682e-31ce-4f64-9f42-5de76a6d2963 req-a1072596-09d6-4eea-82b7-13344b9c83a4 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Received event network-vif-deleted-42dd3fcb-611d-4f7f-ad9e-f3862e010c66 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:34:08 user nova-compute[70709]: INFO nova.compute.manager [req-6d99682e-31ce-4f64-9f42-5de76a6d2963 req-a1072596-09d6-4eea-82b7-13344b9c83a4 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Neutron deleted interface 42dd3fcb-611d-4f7f-ad9e-f3862e010c66; detaching it from the instance and deleting it from the info cache
Jul 28 00:34:08 user nova-compute[70709]: DEBUG nova.network.neutron [req-6d99682e-31ce-4f64-9f42-5de76a6d2963 req-a1072596-09d6-4eea-82b7-13344b9c83a4 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:34:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-6d99682e-31ce-4f64-9f42-5de76a6d2963 req-a1072596-09d6-4eea-82b7-13344b9c83a4 service nova] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Detach interface failed, port_id=42dd3fcb-611d-4f7f-ad9e-f3862e010c66, reason: Instance 39bc08e9-7b3c-4698-921e-429823996ce1 could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:34:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:08 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:34:08 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:34:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:08 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Deleted allocations for instance 39bc08e9-7b3c-4698-921e-429823996ce1
Jul 28 00:34:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b3ae389c-5937-4036-bb47-1fe0b111b51c tempest-ServerBootFromVolumeStableRescueTest-2075329923 tempest-ServerBootFromVolumeStableRescueTest-2075329923-project-member] Lock "39bc08e9-7b3c-4698-921e-429823996ce1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.148s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:34:09 user nova-compute[70709]: INFO nova.compute.claims [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Claim successful on node user
Jul 28 00:34:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:34:09 user nova-compute[70709]: DEBUG nova.network.neutron [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:34:09 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:34:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:34:10 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Creating image(s)
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "/opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "/opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.035s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.175s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG nova.policy [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '182c2d69fdb64ae0bddaca7ccec14d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21413b84362a4244a830986bc663b72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.150s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk 1073741824" returned: 0 in 0.056s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Cannot resize image /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG nova.objects.instance [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lazy-loading 'migration_context' on Instance uuid 2b0ebf99-78aa-4492-adee-f75b2330fef9 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Ensure instance console log exists: /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:11 user nova-compute[70709]: DEBUG nova.network.neutron [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Successfully created port: 9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:34:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:11 user nova-compute[70709]: DEBUG nova.network.neutron [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Successfully updated port: 9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:34:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:34:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquired lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:34:11 user nova-compute[70709]: DEBUG nova.network.neutron [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:34:11 user nova-compute[70709]: DEBUG nova.compute.manager [req-cbb3e838-2369-46df-bbd8-edabaf46141b req-75ce74b8-c32b-41c4-978e-bfa55d563f6b service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-changed-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:34:11 user nova-compute[70709]: DEBUG nova.compute.manager [req-cbb3e838-2369-46df-bbd8-edabaf46141b req-75ce74b8-c32b-41c4-978e-bfa55d563f6b service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Refreshing instance network info cache due to event network-changed-9a67858a-eecb-4d79-9cc7-c07c11f4eebf. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:34:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cbb3e838-2369-46df-bbd8-edabaf46141b req-75ce74b8-c32b-41c4-978e-bfa55d563f6b service nova] Acquiring lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.network.neutron [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.network.neutron [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Updating instance_info_cache with network_info: [{"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Releasing lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Instance network_info: |[{"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cbb3e838-2369-46df-bbd8-edabaf46141b req-75ce74b8-c32b-41c4-978e-bfa55d563f6b service nova] Acquired lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.network.neutron [req-cbb3e838-2369-46df-bbd8-edabaf46141b req-75ce74b8-c32b-41c4-978e-bfa55d563f6b service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Refreshing network info cache for port 9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Start _get_guest_xml network_info=[{"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:34:12 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:34:12 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-272337933',display_name='tempest-TestServerVolumeAttachmentScenario-server-272337933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-272337933',id=38,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0HsORX+nsdjHhbxq9N0GTLbcH2VjBBb/ywTqtebgF/sVXVgOv4JC0n7DLk3gnLNJRZ/ARffSmple06A2NYSV9MMTbglCl3bs4mPPjMxf1CFAUX3J7+/tVVaAK/3IUs9g==',key_name='tempest-keypair-1185571877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21413b84362a4244a830986bc663b72f',ramdisk_id='',reservation_id='r-wa5r38j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-759439176',owner_user_name='tempest-TestServerVolumeAttachmentScenario-759439176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182c2d69fdb64ae0bddaca7ccec14d5e',uuid=2b0ebf99-78aa-4492-adee-f75b2330fef9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Converting VIF {"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=9a67858a-eecb-4d79-9cc7-c07c11f4eebf,network=Network(300fb8c0-10f0-4dd1-90ba-348e0b1b1964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a67858a-ee') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b0ebf99-78aa-4492-adee-f75b2330fef9 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:34:12 user nova-compute[70709]:   <uuid>2b0ebf99-78aa-4492-adee-f75b2330fef9</uuid>
Jul 28 00:34:12 user nova-compute[70709]:   <name>instance-00000026</name>
Jul 28 00:34:12 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:34:12 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:34:12 user nova-compute[70709]:   <metadata>
Jul 28 00:34:12 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:34:12 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:34:12 user nova-compute[70709]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-272337933</nova:name>
Jul 28 00:34:12 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:34:12</nova:creationTime>
Jul 28 00:34:12 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:34:12 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:34:12 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:34:12 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:34:12 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:34:12 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:34:12 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:34:12 user nova-compute[70709]:       <nova:owner>
Jul 28 00:34:12 user nova-compute[70709]:         <nova:user uuid="182c2d69fdb64ae0bddaca7ccec14d5e">tempest-TestServerVolumeAttachmentScenario-759439176-project-member</nova:user>
Jul 28 00:34:12 user nova-compute[70709]:         <nova:project uuid="21413b84362a4244a830986bc663b72f">tempest-TestServerVolumeAttachmentScenario-759439176</nova:project>
Jul 28 00:34:12 user nova-compute[70709]:       </nova:owner>
Jul 28 00:34:12 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:34:12 user nova-compute[70709]:       <nova:ports>
Jul 28 00:34:12 user nova-compute[70709]:         <nova:port uuid="9a67858a-eecb-4d79-9cc7-c07c11f4eebf">
Jul 28 00:34:12 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 28 00:34:12 user nova-compute[70709]:         </nova:port>
Jul 28 00:34:12 user nova-compute[70709]:       </nova:ports>
Jul 28 00:34:12 user nova-compute[70709]:     </nova:instance>
Jul 28 00:34:12 user nova-compute[70709]:   </metadata>
Jul 28 00:34:12 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:34:12 user nova-compute[70709]:     <system>
Jul 28 00:34:12 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:34:12 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:34:12 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:34:12 user nova-compute[70709]:       <entry name="serial">2b0ebf99-78aa-4492-adee-f75b2330fef9</entry>
Jul 28 00:34:12 user nova-compute[70709]:       <entry name="uuid">2b0ebf99-78aa-4492-adee-f75b2330fef9</entry>
Jul 28 00:34:12 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:34:12 user nova-compute[70709]:     </system>
Jul 28 00:34:12 user nova-compute[70709]:   </sysinfo>
Jul 28 00:34:12 user nova-compute[70709]:   <os>
Jul 28 00:34:12 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:34:12 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:34:12 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:34:12 user nova-compute[70709]:   </os>
Jul 28 00:34:12 user nova-compute[70709]:   <features>
Jul 28 00:34:12 user nova-compute[70709]:     <acpi/>
Jul 28 00:34:12 user nova-compute[70709]:     <apic/>
Jul 28 00:34:12 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:34:12 user nova-compute[70709]:   </features>
Jul 28 00:34:12 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:34:12 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:34:12 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:34:12 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:34:12 user nova-compute[70709]:   </clock>
Jul 28 00:34:12 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:34:12 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:34:12 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:34:12 user nova-compute[70709]:   </cpu>
Jul 28 00:34:12 user nova-compute[70709]:   <devices>
Jul 28 00:34:12 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:34:12 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:34:12 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk"/>
Jul 28 00:34:12 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:34:12 user nova-compute[70709]:     </disk>
Jul 28 00:34:12 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:34:12 user nova-compute[70709]:       <mac address="fa:16:3e:3e:40:a2"/>
Jul 28 00:34:12 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:34:12 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:34:12 user nova-compute[70709]:       <target dev="tap9a67858a-ee"/>
Jul 28 00:34:12 user nova-compute[70709]:     </interface>
Jul 28 00:34:12 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:34:12 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/console.log" append="off"/>
Jul 28 00:34:12 user nova-compute[70709]:     </serial>
Jul 28 00:34:12 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:34:12 user nova-compute[70709]:     <video>
Jul 28 00:34:12 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:34:12 user nova-compute[70709]:     </video>
Jul 28 00:34:12 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:34:12 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:34:12 user nova-compute[70709]:     </rng>
Jul 28 00:34:12 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:34:12 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:34:12 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:34:12 user nova-compute[70709]:     </memballoon>
Jul 28 00:34:12 user nova-compute[70709]:   </devices>
Jul 28 00:34:12 user nova-compute[70709]: </domain>
Jul 28 00:34:12 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-272337933',display_name='tempest-TestServerVolumeAttachmentScenario-server-272337933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-272337933',id=38,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0HsORX+nsdjHhbxq9N0GTLbcH2VjBBb/ywTqtebgF/sVXVgOv4JC0n7DLk3gnLNJRZ/ARffSmple06A2NYSV9MMTbglCl3bs4mPPjMxf1CFAUX3J7+/tVVaAK/3IUs9g==',key_name='tempest-keypair-1185571877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21413b84362a4244a830986bc663b72f',ramdisk_id='',reservation_id='r-wa5r38j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-759439176',owner_user_name='tempest-TestServerVolumeAttachmentScenario-759439176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182c2d69fdb64ae0bddaca7ccec14d5e',uuid=2b0ebf99-78aa-4492-adee-f75b2330fef9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Converting VIF {"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=9a67858a-eecb-4d79-9cc7-c07c11f4eebf,network=Network(300fb8c0-10f0-4dd1-90ba-348e0b1b1964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a67858a-ee') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG os_vif [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=9a67858a-eecb-4d79-9cc7-c07c11f4eebf,network=Network(300fb8c0-10f0-4dd1-90ba-348e0b1b1964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a67858a-ee') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a67858a-ee, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a67858a-ee, col_values=(('external_ids', {'iface-id': '9a67858a-eecb-4d79-9cc7-c07c11f4eebf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:40:a2', 'vm-uuid': '2b0ebf99-78aa-4492-adee-f75b2330fef9'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:12 user nova-compute[70709]: INFO os_vif [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=9a67858a-eecb-4d79-9cc7-c07c11f4eebf,network=Network(300fb8c0-10f0-4dd1-90ba-348e0b1b1964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a67858a-ee')
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] No VIF found with MAC fa:16:3e:3e:40:a2, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:34:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:13 user nova-compute[70709]: DEBUG nova.network.neutron [req-cbb3e838-2369-46df-bbd8-edabaf46141b req-75ce74b8-c32b-41c4-978e-bfa55d563f6b service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Updated VIF entry in instance network info cache for port 9a67858a-eecb-4d79-9cc7-c07c11f4eebf. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:34:13 user nova-compute[70709]: DEBUG nova.network.neutron [req-cbb3e838-2369-46df-bbd8-edabaf46141b req-75ce74b8-c32b-41c4-978e-bfa55d563f6b service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Updating instance_info_cache with network_info: [{"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:34:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cbb3e838-2369-46df-bbd8-edabaf46141b req-75ce74b8-c32b-41c4-978e-bfa55d563f6b service nova] Releasing lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-3da1a796-c948-4fc2-95d6-43425c2e3da6 req-50f24a3e-1ba1-46b8-aa84-9fae60b70d6c service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3da1a796-c948-4fc2-95d6-43425c2e3da6 req-50f24a3e-1ba1-46b8-aa84-9fae60b70d6c service nova] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3da1a796-c948-4fc2-95d6-43425c2e3da6 req-50f24a3e-1ba1-46b8-aa84-9fae60b70d6c service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3da1a796-c948-4fc2-95d6-43425c2e3da6 req-50f24a3e-1ba1-46b8-aa84-9fae60b70d6c service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-3da1a796-c948-4fc2-95d6-43425c2e3da6 req-50f24a3e-1ba1-46b8-aa84-9fae60b70d6c service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] No waiting events found dispatching network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:34:14 user nova-compute[70709]: WARNING nova.compute.manager [req-3da1a796-c948-4fc2-95d6-43425c2e3da6 req-50f24a3e-1ba1-46b8-aa84-9fae60b70d6c service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received unexpected event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf for instance with vm_state building and task_state spawning.
Jul 28 00:34:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:34:14 user nova-compute[70709]: INFO nova.compute.claims [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Claim successful on node user
Jul 28 00:34:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:34:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:34:14 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:34:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG nova.policy [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4f5d7ab7bc9485da7b82444b9bd4d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda75c307259403282f8d98700806f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:34:15 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Creating image(s)
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "/opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "/opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk 1073741824" returned: 0 in 0.064s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Cannot resize image /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG nova.objects.instance [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'migration_context' on Instance uuid 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Ensure instance console log exists: /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:15 user nova-compute[70709]: DEBUG nova.network.neutron [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Successfully created port: 1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504456.3869798, 2b0ebf99-78aa-4492-adee-f75b2330fef9 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:34:16 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] VM Resumed (Lifecycle Event)
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:34:16 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Instance spawned successfully.
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:16 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504456.3890305, 2b0ebf99-78aa-4492-adee-f75b2330fef9 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:34:16 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] VM Started (Lifecycle Event)
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-6e6a4d92-04e2-46bc-b33a-29de0b735c7a req-42370bdf-7805-4335-9ecc-aa4eec9a53cc service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6e6a4d92-04e2-46bc-b33a-29de0b735c7a req-42370bdf-7805-4335-9ecc-aa4eec9a53cc service nova] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6e6a4d92-04e2-46bc-b33a-29de0b735c7a req-42370bdf-7805-4335-9ecc-aa4eec9a53cc service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6e6a4d92-04e2-46bc-b33a-29de0b735c7a req-42370bdf-7805-4335-9ecc-aa4eec9a53cc service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-6e6a4d92-04e2-46bc-b33a-29de0b735c7a req-42370bdf-7805-4335-9ecc-aa4eec9a53cc service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] No waiting events found dispatching network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:34:16 user nova-compute[70709]: WARNING nova.compute.manager [req-6e6a4d92-04e2-46bc-b33a-29de0b735c7a req-42370bdf-7805-4335-9ecc-aa4eec9a53cc service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received unexpected event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf for instance with vm_state building and task_state spawning.
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:34:16 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:34:16 user nova-compute[70709]: INFO nova.compute.manager [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Took 6.32 seconds to spawn the instance on the hypervisor.
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.network.neutron [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Successfully updated port: 1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquired lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.network.neutron [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-d25a44c5-8814-427b-a6c6-c85199ef5192 req-47dcfae6-cfcf-49fd-893d-848fe740900b service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received event network-changed-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-d25a44c5-8814-427b-a6c6-c85199ef5192 req-47dcfae6-cfcf-49fd-893d-848fe740900b service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Refreshing instance network info cache due to event network-changed-1264a609-d490-4daa-9641-b722999ed799. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d25a44c5-8814-427b-a6c6-c85199ef5192 req-47dcfae6-cfcf-49fd-893d-848fe740900b service nova] Acquiring lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:34:16 user nova-compute[70709]: INFO nova.compute.manager [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Took 7.10 seconds to build instance.
Jul 28 00:34:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93f4e80d-d180-415f-a874-95b8d8cd6044 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.206s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.network.neutron [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.network.neutron [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Updating instance_info_cache with network_info: [{"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Releasing lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Instance network_info: |[{"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d25a44c5-8814-427b-a6c6-c85199ef5192 req-47dcfae6-cfcf-49fd-893d-848fe740900b service nova] Acquired lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.network.neutron [req-d25a44c5-8814-427b-a6c6-c85199ef5192 req-47dcfae6-cfcf-49fd-893d-848fe740900b service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Refreshing network info cache for port 1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Start _get_guest_xml network_info=[{"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:34:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:34:16 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:34:16 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1757599622',display_name='tempest-TestStampPattern-server-1757599622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1757599622',id=39,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbIsegpiueygcqxDMoqSRPiFzCAnNCeyeO9o7pyraW7IRIG5BvGlYKQLMkQxKgoyxaQdPTaJ/Hf8m0otg97bnUyVJ7NJ5OuhJ+tpoBcvNHMqX4UEk5LyzatE/ojR/Gr9A==',key_name='tempest-TestStampPattern-1821279517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cda75c307259403282f8d98700806f24',ramdisk_id='',reservation_id='r-frvy901l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-734847133',owner_user_name='tempest-TestStampPattern-734847133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:34:15Z,user_data=None,user_id='c4f5d7ab7bc9485da7b82444b9bd4d0a',uuid=0f2efeca-74ee-4d4b-a591-8cd8298d7ceb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converting VIF {"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:06:79,bridge_name='br-int',has_traffic_filtering=True,id=1264a609-d490-4daa-9641-b722999ed799,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264a609-d4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.objects.instance [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:34:17 user nova-compute[70709]:   <uuid>0f2efeca-74ee-4d4b-a591-8cd8298d7ceb</uuid>
Jul 28 00:34:17 user nova-compute[70709]:   <name>instance-00000027</name>
Jul 28 00:34:17 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:34:17 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:34:17 user nova-compute[70709]:   <metadata>
Jul 28 00:34:17 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:34:17 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:34:17 user nova-compute[70709]:       <nova:name>tempest-TestStampPattern-server-1757599622</nova:name>
Jul 28 00:34:17 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:34:16</nova:creationTime>
Jul 28 00:34:17 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:34:17 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:34:17 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:34:17 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:34:17 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:34:17 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:34:17 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:34:17 user nova-compute[70709]:       <nova:owner>
Jul 28 00:34:17 user nova-compute[70709]:         <nova:user uuid="c4f5d7ab7bc9485da7b82444b9bd4d0a">tempest-TestStampPattern-734847133-project-member</nova:user>
Jul 28 00:34:17 user nova-compute[70709]:         <nova:project uuid="cda75c307259403282f8d98700806f24">tempest-TestStampPattern-734847133</nova:project>
Jul 28 00:34:17 user nova-compute[70709]:       </nova:owner>
Jul 28 00:34:17 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:34:17 user nova-compute[70709]:       <nova:ports>
Jul 28 00:34:17 user nova-compute[70709]:         <nova:port uuid="1264a609-d490-4daa-9641-b722999ed799">
Jul 28 00:34:17 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 28 00:34:17 user nova-compute[70709]:         </nova:port>
Jul 28 00:34:17 user nova-compute[70709]:       </nova:ports>
Jul 28 00:34:17 user nova-compute[70709]:     </nova:instance>
Jul 28 00:34:17 user nova-compute[70709]:   </metadata>
Jul 28 00:34:17 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:34:17 user nova-compute[70709]:     <system>
Jul 28 00:34:17 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:34:17 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:34:17 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:34:17 user nova-compute[70709]:       <entry name="serial">0f2efeca-74ee-4d4b-a591-8cd8298d7ceb</entry>
Jul 28 00:34:17 user nova-compute[70709]:       <entry name="uuid">0f2efeca-74ee-4d4b-a591-8cd8298d7ceb</entry>
Jul 28 00:34:17 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:34:17 user nova-compute[70709]:     </system>
Jul 28 00:34:17 user nova-compute[70709]:   </sysinfo>
Jul 28 00:34:17 user nova-compute[70709]:   <os>
Jul 28 00:34:17 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:34:17 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:34:17 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:34:17 user nova-compute[70709]:   </os>
Jul 28 00:34:17 user nova-compute[70709]:   <features>
Jul 28 00:34:17 user nova-compute[70709]:     <acpi/>
Jul 28 00:34:17 user nova-compute[70709]:     <apic/>
Jul 28 00:34:17 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:34:17 user nova-compute[70709]:   </features>
Jul 28 00:34:17 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:34:17 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:34:17 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:34:17 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:34:17 user nova-compute[70709]:   </clock>
Jul 28 00:34:17 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:34:17 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:34:17 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:34:17 user nova-compute[70709]:   </cpu>
Jul 28 00:34:17 user nova-compute[70709]:   <devices>
Jul 28 00:34:17 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:34:17 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:34:17 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk"/>
Jul 28 00:34:17 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:34:17 user nova-compute[70709]:     </disk>
Jul 28 00:34:17 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:34:17 user nova-compute[70709]:       <mac address="fa:16:3e:76:06:79"/>
Jul 28 00:34:17 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:34:17 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:34:17 user nova-compute[70709]:       <target dev="tap1264a609-d4"/>
Jul 28 00:34:17 user nova-compute[70709]:     </interface>
Jul 28 00:34:17 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:34:17 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/console.log" append="off"/>
Jul 28 00:34:17 user nova-compute[70709]:     </serial>
Jul 28 00:34:17 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:34:17 user nova-compute[70709]:     <video>
Jul 28 00:34:17 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:34:17 user nova-compute[70709]:     </video>
Jul 28 00:34:17 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:34:17 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:34:17 user nova-compute[70709]:     </rng>
Jul 28 00:34:17 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:34:17 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:34:17 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:34:17 user nova-compute[70709]:     </memballoon>
Jul 28 00:34:17 user nova-compute[70709]:   </devices>
Jul 28 00:34:17 user nova-compute[70709]: </domain>
Jul 28 00:34:17 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1757599622',display_name='tempest-TestStampPattern-server-1757599622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1757599622',id=39,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbIsegpiueygcqxDMoqSRPiFzCAnNCeyeO9o7pyraW7IRIG5BvGlYKQLMkQxKgoyxaQdPTaJ/Hf8m0otg97bnUyVJ7NJ5OuhJ+tpoBcvNHMqX4UEk5LyzatE/ojR/Gr9A==',key_name='tempest-TestStampPattern-1821279517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cda75c307259403282f8d98700806f24',ramdisk_id='',reservation_id='r-frvy901l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-734847133',owner_user_name='tempest-TestStampPattern-734847133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:34:15Z,user_data=None,user_id='c4f5d7ab7bc9485da7b82444b9bd4d0a',uuid=0f2efeca-74ee-4d4b-a591-8cd8298d7ceb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converting VIF {"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:06:79,bridge_name='br-int',has_traffic_filtering=True,id=1264a609-d490-4daa-9641-b722999ed799,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264a609-d4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG os_vif [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:06:79,bridge_name='br-int',has_traffic_filtering=True,id=1264a609-d490-4daa-9641-b722999ed799,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264a609-d4') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1264a609-d4, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1264a609-d4, col_values=(('external_ids', {'iface-id': '1264a609-d490-4daa-9641-b722999ed799', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:06:79', 'vm-uuid': '0f2efeca-74ee-4d4b-a591-8cd8298d7ceb'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:17 user nova-compute[70709]: INFO os_vif [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:06:79,bridge_name='br-int',has_traffic_filtering=True,id=1264a609-d490-4daa-9641-b722999ed799,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264a609-d4')
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] No VIF found with MAC fa:16:3e:76:06:79, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.network.neutron [req-d25a44c5-8814-427b-a6c6-c85199ef5192 req-47dcfae6-cfcf-49fd-893d-848fe740900b service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Updated VIF entry in instance network info cache for port 1264a609-d490-4daa-9641-b722999ed799. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG nova.network.neutron [req-d25a44c5-8814-427b-a6c6-c85199ef5192 req-47dcfae6-cfcf-49fd-893d-848fe740900b service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Updating instance_info_cache with network_info: [{"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d25a44c5-8814-427b-a6c6-c85199ef5192 req-47dcfae6-cfcf-49fd-893d-848fe740900b service nova] Releasing lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:34:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-00d77d8c-7638-4f7a-85a9-60a0a72aac0b req-ef4c6edc-7623-4f75-9df7-c4c6c1f244c7 service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received event network-vif-plugged-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:34:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-00d77d8c-7638-4f7a-85a9-60a0a72aac0b req-ef4c6edc-7623-4f75-9df7-c4c6c1f244c7 service nova] Acquiring lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-00d77d8c-7638-4f7a-85a9-60a0a72aac0b req-ef4c6edc-7623-4f75-9df7-c4c6c1f244c7 service nova] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-00d77d8c-7638-4f7a-85a9-60a0a72aac0b req-ef4c6edc-7623-4f75-9df7-c4c6c1f244c7 service nova] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-00d77d8c-7638-4f7a-85a9-60a0a72aac0b req-ef4c6edc-7623-4f75-9df7-c4c6c1f244c7 service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] No waiting events found dispatching network-vif-plugged-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:34:18 user nova-compute[70709]: WARNING nova.compute.manager [req-00d77d8c-7638-4f7a-85a9-60a0a72aac0b req-ef4c6edc-7623-4f75-9df7-c4c6c1f244c7 service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received unexpected event network-vif-plugged-1264a609-d490-4daa-9641-b722999ed799 for instance with vm_state building and task_state spawning.
Jul 28 00:34:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-011f38b7-e27e-40d2-98df-186a19a7c734 req-8f3afe91-75b5-495e-86ae-319371f363e8 service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received event network-vif-plugged-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-011f38b7-e27e-40d2-98df-186a19a7c734 req-8f3afe91-75b5-495e-86ae-319371f363e8 service nova] Acquiring lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-011f38b7-e27e-40d2-98df-186a19a7c734 req-8f3afe91-75b5-495e-86ae-319371f363e8 service nova] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-011f38b7-e27e-40d2-98df-186a19a7c734 req-8f3afe91-75b5-495e-86ae-319371f363e8 service nova] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-011f38b7-e27e-40d2-98df-186a19a7c734 req-8f3afe91-75b5-495e-86ae-319371f363e8 service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] No waiting events found dispatching network-vif-plugged-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:34:20 user nova-compute[70709]: WARNING nova.compute.manager [req-011f38b7-e27e-40d2-98df-186a19a7c734 req-8f3afe91-75b5-495e-86ae-319371f363e8 service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received unexpected event network-vif-plugged-1264a609-d490-4daa-9641-b722999ed799 for instance with vm_state building and task_state spawning.
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.compute.manager [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504460.8791578, 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:34:20 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] VM Resumed (Lifecycle Event)
Jul 28 00:34:20 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Instance spawned successfully.
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:34:20 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504460.8801942, 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:34:20 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] VM Started (Lifecycle Event)
Jul 28 00:34:20 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:34:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:34:21 user nova-compute[70709]: INFO nova.compute.manager [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Took 5.96 seconds to spawn the instance on the hypervisor.
Jul 28 00:34:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:34:21 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:34:21 user nova-compute[70709]: INFO nova.compute.manager [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Took 6.69 seconds to build instance.
Jul 28 00:34:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-729ba663-67af-483f-af65-e1226f418c8b tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.842s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:21 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504446.7684586, 39bc08e9-7b3c-4698-921e-429823996ce1 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:34:21 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] VM Stopped (Lifecycle Event)
Jul 28 00:34:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-1540df8c-0253-42c7-a54f-acd53cb16ff1 None None] [instance: 39bc08e9-7b3c-4698-921e-429823996ce1] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:34:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:34:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:21 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:34:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:34:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:34:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:23 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:34:23 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:34:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8468MB free_disk=25.427162170410156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance aeb18468-b813-42ff-9f27-9fc3bab1aaf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:34:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:34:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:34:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:34:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:34:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:34:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:34:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:34:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:34:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:38 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:34:38 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:34:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:34:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:34:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:34:39 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:34:39 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Updating instance_info_cache with network_info: [{"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:34:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:34:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:34:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:34:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-5303a5fa-36f7-47fe-961d-902630b28eac req-54a5b0df-ca56-4081-8601-457d36f09ce1 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Received event network-changed-83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:35:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-5303a5fa-36f7-47fe-961d-902630b28eac req-54a5b0df-ca56-4081-8601-457d36f09ce1 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Refreshing instance network info cache due to event network-changed-83039e8b-4639-43c6-a08d-48aeed4ee020. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:35:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5303a5fa-36f7-47fe-961d-902630b28eac req-54a5b0df-ca56-4081-8601-457d36f09ce1 service nova] Acquiring lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:35:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5303a5fa-36f7-47fe-961d-902630b28eac req-54a5b0df-ca56-4081-8601-457d36f09ce1 service nova] Acquired lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:35:05 user nova-compute[70709]: DEBUG nova.network.neutron [req-5303a5fa-36f7-47fe-961d-902630b28eac req-54a5b0df-ca56-4081-8601-457d36f09ce1 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Refreshing network info cache for port 83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:35:06 user nova-compute[70709]: DEBUG nova.network.neutron [req-5303a5fa-36f7-47fe-961d-902630b28eac req-54a5b0df-ca56-4081-8601-457d36f09ce1 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Updated VIF entry in instance network info cache for port 83039e8b-4639-43c6-a08d-48aeed4ee020. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:35:06 user nova-compute[70709]: DEBUG nova.network.neutron [req-5303a5fa-36f7-47fe-961d-902630b28eac req-54a5b0df-ca56-4081-8601-457d36f09ce1 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Updating instance_info_cache with network_info: [{"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:35:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5303a5fa-36f7-47fe-961d-902630b28eac req-54a5b0df-ca56-4081-8601-457d36f09ce1 service nova] Releasing lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:35:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:35:11 user nova-compute[70709]: INFO nova.compute.claims [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Claim successful on node user
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.network.neutron [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:35:11 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.policy [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8afed76354148e290f0b4f602616818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad38eeba09ce4551899f892ea787ea1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:35:11 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Creating image(s)
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "/opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:11 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:35:11 user nova-compute[70709]: INFO nova.compute.claims [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Claim successful on node user
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.150s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk 1073741824" returned: 0 in 0.066s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:35:12 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Cannot resize image /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.objects.instance [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'migration_context' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Ensure instance console log exists: /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.policy [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8afed76354148e290f0b4f602616818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad38eeba09ce4551899f892ea787ea1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:35:12 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Creating image(s)
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG nova.network.neutron [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Successfully created port: 2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.155s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.158s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk 1073741824" returned: 0 in 0.081s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Cannot resize image /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG nova.objects.instance [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'migration_context' on Instance uuid 4d016cd1-fe5e-4ec9-9105-5450d99c9599 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Ensure instance console log exists: /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Successfully created port: d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG nova.network.neutron [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Successfully updated port: 2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquired lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG nova.network.neutron [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG nova.network.neutron [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG nova.compute.manager [req-7e779208-4a06-4c28-bd48-216cf1362dd1 req-d4c13516-e4d3-4475-b0dc-acbd9361c819 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-changed-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG nova.compute.manager [req-7e779208-4a06-4c28-bd48-216cf1362dd1 req-d4c13516-e4d3-4475-b0dc-acbd9361c819 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Refreshing instance network info cache due to event network-changed-2b266b04-6203-458a-b727-e7f2e4ab00a7. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:35:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7e779208-4a06-4c28-bd48-216cf1362dd1 req-d4c13516-e4d3-4475-b0dc-acbd9361c819 service nova] Acquiring lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updating instance_info_cache with network_info: [{"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Releasing lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Instance network_info: |[{"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7e779208-4a06-4c28-bd48-216cf1362dd1 req-d4c13516-e4d3-4475-b0dc-acbd9361c819 service nova] Acquired lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.neutron [req-7e779208-4a06-4c28-bd48-216cf1362dd1 req-d4c13516-e4d3-4475-b0dc-acbd9361c819 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Refreshing network info cache for port 2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Start _get_guest_xml network_info=[{"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:35:14 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:35:14 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2111279381',display_name='tempest-ServerRescueNegativeTestJSON-server-2111279381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2111279381',id=40,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-8jk89xcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:35:12Z,user_data=None,user_id='d8afed76354148e290f0b4f602616818',uuid=96099a70-86f0-4f81-877a-2f30c8c126f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9c:31,bridge_name='br-int',has_traffic_filtering=True,id=2b266b04-6203-458a-b727-e7f2e4ab00a7,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b266b04-62') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.objects.instance [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'pci_devices' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:35:14 user nova-compute[70709]:   <uuid>96099a70-86f0-4f81-877a-2f30c8c126f8</uuid>
Jul 28 00:35:14 user nova-compute[70709]:   <name>instance-00000028</name>
Jul 28 00:35:14 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:35:14 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:35:14 user nova-compute[70709]:   <metadata>
Jul 28 00:35:14 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:35:14 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2111279381</nova:name>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:35:14</nova:creationTime>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:35:14 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:35:14 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:owner>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:user uuid="d8afed76354148e290f0b4f602616818">tempest-ServerRescueNegativeTestJSON-1040689578-project-member</nova:user>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:project uuid="ad38eeba09ce4551899f892ea787ea1c">tempest-ServerRescueNegativeTestJSON-1040689578</nova:project>
Jul 28 00:35:14 user nova-compute[70709]:       </nova:owner>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:ports>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:port uuid="2b266b04-6203-458a-b727-e7f2e4ab00a7">
Jul 28 00:35:14 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 28 00:35:14 user nova-compute[70709]:         </nova:port>
Jul 28 00:35:14 user nova-compute[70709]:       </nova:ports>
Jul 28 00:35:14 user nova-compute[70709]:     </nova:instance>
Jul 28 00:35:14 user nova-compute[70709]:   </metadata>
Jul 28 00:35:14 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:35:14 user nova-compute[70709]:     <system>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="serial">96099a70-86f0-4f81-877a-2f30c8c126f8</entry>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="uuid">96099a70-86f0-4f81-877a-2f30c8c126f8</entry>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:35:14 user nova-compute[70709]:     </system>
Jul 28 00:35:14 user nova-compute[70709]:   </sysinfo>
Jul 28 00:35:14 user nova-compute[70709]:   <os>
Jul 28 00:35:14 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:35:14 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:35:14 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:35:14 user nova-compute[70709]:   </os>
Jul 28 00:35:14 user nova-compute[70709]:   <features>
Jul 28 00:35:14 user nova-compute[70709]:     <acpi/>
Jul 28 00:35:14 user nova-compute[70709]:     <apic/>
Jul 28 00:35:14 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:35:14 user nova-compute[70709]:   </features>
Jul 28 00:35:14 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:35:14 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:35:14 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:35:14 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:35:14 user nova-compute[70709]:   </clock>
Jul 28 00:35:14 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:35:14 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:35:14 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:35:14 user nova-compute[70709]:   </cpu>
Jul 28 00:35:14 user nova-compute[70709]:   <devices>
Jul 28 00:35:14 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:35:14 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:35:14 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk"/>
Jul 28 00:35:14 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:35:14 user nova-compute[70709]:     </disk>
Jul 28 00:35:14 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:35:14 user nova-compute[70709]:       <mac address="fa:16:3e:b6:9c:31"/>
Jul 28 00:35:14 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:35:14 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:35:14 user nova-compute[70709]:       <target dev="tap2b266b04-62"/>
Jul 28 00:35:14 user nova-compute[70709]:     </interface>
Jul 28 00:35:14 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:35:14 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/console.log" append="off"/>
Jul 28 00:35:14 user nova-compute[70709]:     </serial>
Jul 28 00:35:14 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:35:14 user nova-compute[70709]:     <video>
Jul 28 00:35:14 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:35:14 user nova-compute[70709]:     </video>
Jul 28 00:35:14 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:35:14 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:35:14 user nova-compute[70709]:     </rng>
Jul 28 00:35:14 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:35:14 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:35:14 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:35:14 user nova-compute[70709]:     </memballoon>
Jul 28 00:35:14 user nova-compute[70709]:   </devices>
Jul 28 00:35:14 user nova-compute[70709]: </domain>
Jul 28 00:35:14 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2111279381',display_name='tempest-ServerRescueNegativeTestJSON-server-2111279381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2111279381',id=40,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-8jk89xcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:35:12Z,user_data=None,user_id='d8afed76354148e290f0b4f602616818',uuid=96099a70-86f0-4f81-877a-2f30c8c126f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9c:31,bridge_name='br-int',has_traffic_filtering=True,id=2b266b04-6203-458a-b727-e7f2e4ab00a7,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b266b04-62') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG os_vif [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9c:31,bridge_name='br-int',has_traffic_filtering=True,id=2b266b04-6203-458a-b727-e7f2e4ab00a7,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b266b04-62') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b266b04-62, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b266b04-62, col_values=(('external_ids', {'iface-id': '2b266b04-6203-458a-b727-e7f2e4ab00a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:9c:31', 'vm-uuid': '96099a70-86f0-4f81-877a-2f30c8c126f8'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:14 user nova-compute[70709]: INFO os_vif [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9c:31,bridge_name='br-int',has_traffic_filtering=True,id=2b266b04-6203-458a-b727-e7f2e4ab00a7,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b266b04-62')
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No VIF found with MAC fa:16:3e:b6:9c:31, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Successfully updated port: d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquired lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.neutron [req-7e779208-4a06-4c28-bd48-216cf1362dd1 req-d4c13516-e4d3-4475-b0dc-acbd9361c819 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updated VIF entry in instance network info cache for port 2b266b04-6203-458a-b727-e7f2e4ab00a7. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.neutron [req-7e779208-4a06-4c28-bd48-216cf1362dd1 req-d4c13516-e4d3-4475-b0dc-acbd9361c819 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updating instance_info_cache with network_info: [{"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-e9fdc10d-9350-4d12-af5a-f62ffca00da2 req-1f21342f-a9bc-4131-9685-a26f1b92fff9 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received event network-changed-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-e9fdc10d-9350-4d12-af5a-f62ffca00da2 req-1f21342f-a9bc-4131-9685-a26f1b92fff9 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Refreshing instance network info cache due to event network-changed-d9ae9215-f02d-4969-ba43-f7ae789ad860. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e9fdc10d-9350-4d12-af5a-f62ffca00da2 req-1f21342f-a9bc-4131-9685-a26f1b92fff9 service nova] Acquiring lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7e779208-4a06-4c28-bd48-216cf1362dd1 req-d4c13516-e4d3-4475-b0dc-acbd9361c819 service nova] Releasing lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.neutron [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updating instance_info_cache with network_info: [{"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Releasing lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Instance network_info: |[{"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e9fdc10d-9350-4d12-af5a-f62ffca00da2 req-1f21342f-a9bc-4131-9685-a26f1b92fff9 service nova] Acquired lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.neutron [req-e9fdc10d-9350-4d12-af5a-f62ffca00da2 req-1f21342f-a9bc-4131-9685-a26f1b92fff9 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Refreshing network info cache for port d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Start _get_guest_xml network_info=[{"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:35:14 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:35:14 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1655829224',display_name='tempest-ServerRescueNegativeTestJSON-server-1655829224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1655829224',id=41,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-iqt1ls02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:35:13Z,user_data=None,user_id='d8afed76354148e290f0b4f602616818',uuid=4d016cd1-fe5e-4ec9-9105-5450d99c9599,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7d:fd,bridge_name='br-int',has_traffic_filtering=True,id=d9ae9215-f02d-4969-ba43-f7ae789ad860,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae9215-f0') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.objects.instance [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d016cd1-fe5e-4ec9-9105-5450d99c9599 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:35:14 user nova-compute[70709]:   <uuid>4d016cd1-fe5e-4ec9-9105-5450d99c9599</uuid>
Jul 28 00:35:14 user nova-compute[70709]:   <name>instance-00000029</name>
Jul 28 00:35:14 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:35:14 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:35:14 user nova-compute[70709]:   <metadata>
Jul 28 00:35:14 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:35:14 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1655829224</nova:name>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:35:14</nova:creationTime>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:35:14 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:35:14 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:owner>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:user uuid="d8afed76354148e290f0b4f602616818">tempest-ServerRescueNegativeTestJSON-1040689578-project-member</nova:user>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:project uuid="ad38eeba09ce4551899f892ea787ea1c">tempest-ServerRescueNegativeTestJSON-1040689578</nova:project>
Jul 28 00:35:14 user nova-compute[70709]:       </nova:owner>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:35:14 user nova-compute[70709]:       <nova:ports>
Jul 28 00:35:14 user nova-compute[70709]:         <nova:port uuid="d9ae9215-f02d-4969-ba43-f7ae789ad860">
Jul 28 00:35:14 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 28 00:35:14 user nova-compute[70709]:         </nova:port>
Jul 28 00:35:14 user nova-compute[70709]:       </nova:ports>
Jul 28 00:35:14 user nova-compute[70709]:     </nova:instance>
Jul 28 00:35:14 user nova-compute[70709]:   </metadata>
Jul 28 00:35:14 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:35:14 user nova-compute[70709]:     <system>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="serial">4d016cd1-fe5e-4ec9-9105-5450d99c9599</entry>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="uuid">4d016cd1-fe5e-4ec9-9105-5450d99c9599</entry>
Jul 28 00:35:14 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:35:14 user nova-compute[70709]:     </system>
Jul 28 00:35:14 user nova-compute[70709]:   </sysinfo>
Jul 28 00:35:14 user nova-compute[70709]:   <os>
Jul 28 00:35:14 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:35:14 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:35:14 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:35:14 user nova-compute[70709]:   </os>
Jul 28 00:35:14 user nova-compute[70709]:   <features>
Jul 28 00:35:14 user nova-compute[70709]:     <acpi/>
Jul 28 00:35:14 user nova-compute[70709]:     <apic/>
Jul 28 00:35:14 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:35:14 user nova-compute[70709]:   </features>
Jul 28 00:35:14 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:35:14 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:35:14 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:35:14 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:35:14 user nova-compute[70709]:   </clock>
Jul 28 00:35:14 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:35:14 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:35:14 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:35:14 user nova-compute[70709]:   </cpu>
Jul 28 00:35:14 user nova-compute[70709]:   <devices>
Jul 28 00:35:14 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:35:14 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:35:14 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk"/>
Jul 28 00:35:14 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:35:14 user nova-compute[70709]:     </disk>
Jul 28 00:35:14 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:35:14 user nova-compute[70709]:       <mac address="fa:16:3e:d5:7d:fd"/>
Jul 28 00:35:14 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:35:14 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:35:14 user nova-compute[70709]:       <target dev="tapd9ae9215-f0"/>
Jul 28 00:35:14 user nova-compute[70709]:     </interface>
Jul 28 00:35:14 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:35:14 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/console.log" append="off"/>
Jul 28 00:35:14 user nova-compute[70709]:     </serial>
Jul 28 00:35:14 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:35:14 user nova-compute[70709]:     <video>
Jul 28 00:35:14 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:35:14 user nova-compute[70709]:     </video>
Jul 28 00:35:14 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:35:14 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:35:14 user nova-compute[70709]:     </rng>
Jul 28 00:35:14 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:35:14 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:35:14 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:35:14 user nova-compute[70709]:     </memballoon>
Jul 28 00:35:14 user nova-compute[70709]:   </devices>
Jul 28 00:35:14 user nova-compute[70709]: </domain>
Jul 28 00:35:14 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1655829224',display_name='tempest-ServerRescueNegativeTestJSON-server-1655829224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1655829224',id=41,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-iqt1ls02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:35:13Z,user_data=None,user_id='d8afed76354148e290f0b4f602616818',uuid=4d016cd1-fe5e-4ec9-9105-5450d99c9599,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7d:fd,bridge_name='br-int',has_traffic_filtering=True,id=d9ae9215-f02d-4969-ba43-f7ae789ad860,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae9215-f0') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG os_vif [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7d:fd,bridge_name='br-int',has_traffic_filtering=True,id=d9ae9215-f02d-4969-ba43-f7ae789ad860,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae9215-f0') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9ae9215-f0, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9ae9215-f0, col_values=(('external_ids', {'iface-id': 'd9ae9215-f02d-4969-ba43-f7ae789ad860', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:7d:fd', 'vm-uuid': '4d016cd1-fe5e-4ec9-9105-5450d99c9599'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:14 user nova-compute[70709]: INFO os_vif [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7d:fd,bridge_name='br-int',has_traffic_filtering=True,id=d9ae9215-f02d-4969-ba43-f7ae789ad860,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae9215-f0')
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:35:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No VIF found with MAC fa:16:3e:d5:7d:fd, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG nova.network.neutron [req-e9fdc10d-9350-4d12-af5a-f62ffca00da2 req-1f21342f-a9bc-4131-9685-a26f1b92fff9 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updated VIF entry in instance network info cache for port d9ae9215-f02d-4969-ba43-f7ae789ad860. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG nova.network.neutron [req-e9fdc10d-9350-4d12-af5a-f62ffca00da2 req-1f21342f-a9bc-4131-9685-a26f1b92fff9 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updating instance_info_cache with network_info: [{"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e9fdc10d-9350-4d12-af5a-f62ffca00da2 req-1f21342f-a9bc-4131-9685-a26f1b92fff9 service nova] Releasing lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:35:15 user nova-compute[70709]: INFO nova.compute.claims [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Claim successful on node user
Jul 28 00:35:15 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:15 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:35:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG nova.network.neutron [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:35:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:35:16 user nova-compute[70709]: INFO nova.virt.block_device [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Booting with volume snapshot 8d8b9087-588c-42d0-941f-c80ab5d95826 at /dev/vda
Jul 28 00:35:16 user nova-compute[70709]: DEBUG nova.policy [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd994eb215f204b029d183b73539e3d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d88e18679b4bc49c010b68ca813dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:35:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-a02992ce-7058-4492-9786-cc0fc23f46b7 req-9dc2ca09-e459-48d1-9c9d-95a3bbc2640c service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:35:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a02992ce-7058-4492-9786-cc0fc23f46b7 req-9dc2ca09-e459-48d1-9c9d-95a3bbc2640c service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a02992ce-7058-4492-9786-cc0fc23f46b7 req-9dc2ca09-e459-48d1-9c9d-95a3bbc2640c service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a02992ce-7058-4492-9786-cc0fc23f46b7 req-9dc2ca09-e459-48d1-9c9d-95a3bbc2640c service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:16 user nova-compute[70709]: DEBUG nova.compute.manager [req-a02992ce-7058-4492-9786-cc0fc23f46b7 req-9dc2ca09-e459-48d1-9c9d-95a3bbc2640c service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:35:16 user nova-compute[70709]: WARNING nova.compute.manager [req-a02992ce-7058-4492-9786-cc0fc23f46b7 req-9dc2ca09-e459-48d1-9c9d-95a3bbc2640c service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received unexpected event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with vm_state building and task_state spawning.
Jul 28 00:35:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:17 user nova-compute[70709]: DEBUG nova.network.neutron [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Successfully created port: 2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:35:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG nova.network.neutron [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Successfully updated port: 2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "refresh_cache-ca0ae88f-8b50-48da-b1f6-4358248ccc6c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquired lock "refresh_cache-ca0ae88f-8b50-48da-b1f6-4358248ccc6c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG nova.network.neutron [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG nova.network.neutron [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:35:18 user nova-compute[70709]: WARNING nova.compute.manager [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received unexpected event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with vm_state building and task_state spawning.
Jul 28 00:35:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] No waiting events found dispatching network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:35:18 user nova-compute[70709]: WARNING nova.compute.manager [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received unexpected event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 for instance with vm_state building and task_state spawning.
Jul 28 00:35:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] No waiting events found dispatching network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:35:18 user nova-compute[70709]: WARNING nova.compute.manager [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received unexpected event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 for instance with vm_state building and task_state spawning.
Jul 28 00:35:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Received event network-changed-2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Refreshing instance network info cache due to event network-changed-2a996a33-f147-4204-8112-588882843b92. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:35:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Acquiring lock "refresh_cache-ca0ae88f-8b50-48da-b1f6-4358248ccc6c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.network.neutron [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Updating instance_info_cache with network_info: [{"id": "2a996a33-f147-4204-8112-588882843b92", "address": "fa:16:3e:2d:96:25", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a996a33-f1", "ovs_interfaceid": "2a996a33-f147-4204-8112-588882843b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Releasing lock "refresh_cache-ca0ae88f-8b50-48da-b1f6-4358248ccc6c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Instance network_info: |[{"id": "2a996a33-f147-4204-8112-588882843b92", "address": "fa:16:3e:2d:96:25", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a996a33-f1", "ovs_interfaceid": "2a996a33-f147-4204-8112-588882843b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Acquired lock "refresh_cache-ca0ae88f-8b50-48da-b1f6-4358248ccc6c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.network.neutron [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Refreshing network info cache for port 2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504519.4291906, 96099a70-86f0-4f81-877a-2f30c8c126f8 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] VM Resumed (Lifecycle Event)
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Instance spawned successfully.
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504519.4296112, 96099a70-86f0-4f81-877a-2f30c8c126f8 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] VM Started (Lifecycle Event)
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504519.5594673, 4d016cd1-fe5e-4ec9-9105-5450d99c9599 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] VM Resumed (Lifecycle Event)
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Instance spawned successfully.
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504519.5614927, 4d016cd1-fe5e-4ec9-9105-5450d99c9599 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] VM Started (Lifecycle Event)
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Took 7.82 seconds to spawn the instance on the hypervisor.
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Took 7.07 seconds to spawn the instance on the hypervisor.
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.network.neutron [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Updated VIF entry in instance network info cache for port 2a996a33-f147-4204-8112-588882843b92. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG nova.network.neutron [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Updating instance_info_cache with network_info: [{"id": "2a996a33-f147-4204-8112-588882843b92", "address": "fa:16:3e:2d:96:25", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a996a33-f1", "ovs_interfaceid": "2a996a33-f147-4204-8112-588882843b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-91e6b549-65dd-4851-99c2-28de3c98661f req-ecabb33b-64d9-4776-812a-b2beec717ff9 service nova] Releasing lock "refresh_cache-ca0ae88f-8b50-48da-b1f6-4358248ccc6c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Took 8.47 seconds to build instance.
Jul 28 00:35:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-edb88990-18d5-483d-8947-f6f4ef1b77e7 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.578s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:19 user nova-compute[70709]: INFO nova.compute.manager [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Took 7.99 seconds to build instance.
Jul 28 00:35:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ad7e58ef-4118-4029-9bec-7297459994a6 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.090s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:20 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:21 user nova-compute[70709]: DEBUG os_brick.utils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:35:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a586f311-c72c-4bf2-b319-f8a1ae754a74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7135ade2-6986-4476-8c72-69217d143b8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f6ee57-1ac7-4bd1-8202-76f96003c922]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d58752c-012b-47af-ba1a-2f3b16a249c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:35:22 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:35:22 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b84db2-6df2-490f-b8d8-9218b582e5f9]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG os_brick.utils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Updating existing volume attachment record: ec468c80-4fa9-4ebc-87f3-0ec4333272d2 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:35:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:23 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:35:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:25 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:35:25 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:35:25 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8271MB free_disk=25.35633087158203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:35:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance aeb18468-b813-42ff-9f27-9fc3bab1aaf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance ca0ae88f-8b50-48da-b1f6-4358248ccc6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 00:35:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:35:29 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Creating image(s)
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Ensure instance console log exists: /opt/stack/data/nova/instances/ca0ae88f-8b50-48da-b1f6-4358248ccc6c/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Start _get_guest_xml network_info=[{"id": "2a996a33-f147-4204-8112-588882843b92", "address": "fa:16:3e:2d:96:25", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a996a33-f1", "ovs_interfaceid": "2a996a33-f147-4204-8112-588882843b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-28T00:35:07Z,direct_url=<?>,disk_format='qcow2',id=a1433ad4-0e2d-4259-a60c-1767392ca9a1,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2005967585',owner='47d88e18679b4bc49c010b68ca813dab',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-28T00:35:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'ec468c80-4fa9-4ebc-87f3-0ec4333272d2', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNstzMiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca0ae88f-8b50-48da-b1f6-4358248ccc6c', 'attached_at': '', 'detached_at': '', 'volume_id': '44c669e8-9c40-4c80-be3f-ba3710488db2', 'serial': '44c669e8-9c40-4c80-be3f-ba3710488db2'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:29 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:35:29 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-28T00:35:07Z,direct_url=<?>,disk_format='qcow2',id=a1433ad4-0e2d-4259-a60c-1767392ca9a1,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2005967585',owner='47d88e18679b4bc49c010b68ca813dab',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-28T00:35:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNstzMiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:35:29 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:35:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:35:29 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:35:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:35:29 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[525ee5ab-4c95-4ba3-9c1c-cc4e9939d211]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:35:29 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ef0289-7652-4964-a0ac-290ab8a8dcbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2] added
Jul 28 00:35:29 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[729a07ac-ca4a-4fb8-ba4d-e19c5fc0cbba]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:35:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ef6b57-1c3e-40fa-a91e-48eef7bdebbb]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNstzMiv {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNstzMiv" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f530b28-2f75-485f-bab4-0c21aaf34edf]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZNstzMiv'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78379bd-309f-4744-afad-f67abf1d2ff3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98a1cd8-98ef-42f0-8244-977a85a92220]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:35:30 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:35:30 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f70d1ef-f8b4-4322-93ca-cf599625285b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2, portal: 172.16.0.220,3260]
Jul 28 00:35:30 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2, portal: 172.16.0.220,3260] successful.
Jul 28 00:35:30 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2374732b-2a51-4b5d-8d86-a4273584d814]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3277d5-bbb0-4bcc-881c-b606fab5b44a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:35:30 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:35:30 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:35:30 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:35:30 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee80320-aa8e-432c-9762-8163d43e6ce1]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:35:30 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNstzMiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26532363130346535', 'path': '/dev/sdc'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532363130346535', 'path': '/dev/sdc'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-204948545',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-204948545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-204948545',id=42,image_ref='a1433ad4-0e2d-4259-a60c-1767392ca9a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJdFXBBG8Km0R7bavbQPOaK3NRiBPwuiNjSbmcoL5C1r63tGGaR8QTmVr6uIsJCyx7eblCVLWvztKqiU2MWf0SNIhT/fcaCUzUHps6TY2SKDobRhLs28r8iAoWt21R66w==',key_name='tempest-keypair-136906390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-ed7x7ps0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2090046407',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d994eb215f204b029d183b73539e3d4d',uuid=ca0ae88f-8b50-48da-b1f6-4358248ccc6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a996a33-f147-4204-8112-588882843b92", "address": "fa:16:3e:2d:96:25", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a996a33-f1", "ovs_interfaceid": "2a996a33-f147-4204-8112-588882843b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "2a996a33-f147-4204-8112-588882843b92", "address": "fa:16:3e:2d:96:25", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a996a33-f1", "ovs_interfaceid": "2a996a33-f147-4204-8112-588882843b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:96:25,bridge_name='br-int',has_traffic_filtering=True,id=2a996a33-f147-4204-8112-588882843b92,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a996a33-f1') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG nova.objects.instance [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'pci_devices' on Instance uuid ca0ae88f-8b50-48da-b1f6-4358248ccc6c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:35:31 user nova-compute[70709]:   <uuid>ca0ae88f-8b50-48da-b1f6-4358248ccc6c</uuid>
Jul 28 00:35:31 user nova-compute[70709]:   <name>instance-0000002a</name>
Jul 28 00:35:31 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:35:31 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:35:31 user nova-compute[70709]:   <metadata>
Jul 28 00:35:31 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:35:31 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:35:31 user nova-compute[70709]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-204948545</nova:name>
Jul 28 00:35:31 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:35:29</nova:creationTime>
Jul 28 00:35:31 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:35:31 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:35:31 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:35:31 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:35:31 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:35:31 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:35:31 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:35:31 user nova-compute[70709]:       <nova:owner>
Jul 28 00:35:31 user nova-compute[70709]:         <nova:user uuid="d994eb215f204b029d183b73539e3d4d">tempest-TestVolumeBootPattern-2090046407-project-member</nova:user>
Jul 28 00:35:31 user nova-compute[70709]:         <nova:project uuid="47d88e18679b4bc49c010b68ca813dab">tempest-TestVolumeBootPattern-2090046407</nova:project>
Jul 28 00:35:31 user nova-compute[70709]:       </nova:owner>
Jul 28 00:35:31 user nova-compute[70709]:       <nova:root type="image" uuid="a1433ad4-0e2d-4259-a60c-1767392ca9a1"/>
Jul 28 00:35:31 user nova-compute[70709]:       <nova:ports>
Jul 28 00:35:31 user nova-compute[70709]:         <nova:port uuid="2a996a33-f147-4204-8112-588882843b92">
Jul 28 00:35:31 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 28 00:35:31 user nova-compute[70709]:         </nova:port>
Jul 28 00:35:31 user nova-compute[70709]:       </nova:ports>
Jul 28 00:35:31 user nova-compute[70709]:     </nova:instance>
Jul 28 00:35:31 user nova-compute[70709]:   </metadata>
Jul 28 00:35:31 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:35:31 user nova-compute[70709]:     <system>
Jul 28 00:35:31 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:35:31 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:35:31 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:35:31 user nova-compute[70709]:       <entry name="serial">ca0ae88f-8b50-48da-b1f6-4358248ccc6c</entry>
Jul 28 00:35:31 user nova-compute[70709]:       <entry name="uuid">ca0ae88f-8b50-48da-b1f6-4358248ccc6c</entry>
Jul 28 00:35:31 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:35:31 user nova-compute[70709]:     </system>
Jul 28 00:35:31 user nova-compute[70709]:   </sysinfo>
Jul 28 00:35:31 user nova-compute[70709]:   <os>
Jul 28 00:35:31 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:35:31 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:35:31 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:35:31 user nova-compute[70709]:   </os>
Jul 28 00:35:31 user nova-compute[70709]:   <features>
Jul 28 00:35:31 user nova-compute[70709]:     <acpi/>
Jul 28 00:35:31 user nova-compute[70709]:     <apic/>
Jul 28 00:35:31 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:35:31 user nova-compute[70709]:   </features>
Jul 28 00:35:31 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:35:31 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:35:31 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:35:31 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:35:31 user nova-compute[70709]:   </clock>
Jul 28 00:35:31 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:35:31 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:35:31 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:35:31 user nova-compute[70709]:   </cpu>
Jul 28 00:35:31 user nova-compute[70709]:   <devices>
Jul 28 00:35:31 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:35:31 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:35:31 user nova-compute[70709]:       <source dev="/dev/sdc"/>
Jul 28 00:35:31 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:35:31 user nova-compute[70709]:       <serial>44c669e8-9c40-4c80-be3f-ba3710488db2</serial>
Jul 28 00:35:31 user nova-compute[70709]:     </disk>
Jul 28 00:35:31 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:35:31 user nova-compute[70709]:       <mac address="fa:16:3e:2d:96:25"/>
Jul 28 00:35:31 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:35:31 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:35:31 user nova-compute[70709]:       <target dev="tap2a996a33-f1"/>
Jul 28 00:35:31 user nova-compute[70709]:     </interface>
Jul 28 00:35:31 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:35:31 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/ca0ae88f-8b50-48da-b1f6-4358248ccc6c/console.log" append="off"/>
Jul 28 00:35:31 user nova-compute[70709]:     </serial>
Jul 28 00:35:31 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:35:31 user nova-compute[70709]:     <video>
Jul 28 00:35:31 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:35:31 user nova-compute[70709]:     </video>
Jul 28 00:35:31 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:35:31 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:35:31 user nova-compute[70709]:     </rng>
Jul 28 00:35:31 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:35:31 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:35:31 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:35:31 user nova-compute[70709]:     </memballoon>
Jul 28 00:35:31 user nova-compute[70709]:   </devices>
Jul 28 00:35:31 user nova-compute[70709]: </domain>
Jul 28 00:35:31 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-204948545',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-204948545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-204948545',id=42,image_ref='a1433ad4-0e2d-4259-a60c-1767392ca9a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJdFXBBG8Km0R7bavbQPOaK3NRiBPwuiNjSbmcoL5C1r63tGGaR8QTmVr6uIsJCyx7eblCVLWvztKqiU2MWf0SNIhT/fcaCUzUHps6TY2SKDobRhLs28r8iAoWt21R66w==',key_name='tempest-keypair-136906390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-ed7x7ps0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2090046407',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d994eb215f204b029d183b73539e3d4d',uuid=ca0ae88f-8b50-48da-b1f6-4358248ccc6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a996a33-f147-4204-8112-588882843b92", "address": "fa:16:3e:2d:96:25", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a996a33-f1", "ovs_interfaceid": "2a996a33-f147-4204-8112-588882843b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "2a996a33-f147-4204-8112-588882843b92", "address": "fa:16:3e:2d:96:25", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a996a33-f1", "ovs_interfaceid": "2a996a33-f147-4204-8112-588882843b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:96:25,bridge_name='br-int',has_traffic_filtering=True,id=2a996a33-f147-4204-8112-588882843b92,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a996a33-f1') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG os_vif [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:96:25,bridge_name='br-int',has_traffic_filtering=True,id=2a996a33-f147-4204-8112-588882843b92,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a996a33-f1') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a996a33-f1, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a996a33-f1, col_values=(('external_ids', {'iface-id': '2a996a33-f147-4204-8112-588882843b92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:96:25', 'vm-uuid': 'ca0ae88f-8b50-48da-b1f6-4358248ccc6c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:31 user nova-compute[70709]: INFO os_vif [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:96:25,bridge_name='br-int',has_traffic_filtering=True,id=2a996a33-f147-4204-8112-588882843b92,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a996a33-f1')
Jul 28 00:35:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:35:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No VIF found with MAC fa:16:3e:2d:96:25, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:35:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-bfba92a9-0f1d-4e5a-94d4-9590cf5b26a3 req-148ac0fc-c386-4f2e-9b32-de1d8e21b4a6 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Received event network-vif-plugged-2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:35:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bfba92a9-0f1d-4e5a-94d4-9590cf5b26a3 req-148ac0fc-c386-4f2e-9b32-de1d8e21b4a6 service nova] Acquiring lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bfba92a9-0f1d-4e5a-94d4-9590cf5b26a3 req-148ac0fc-c386-4f2e-9b32-de1d8e21b4a6 service nova] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-bfba92a9-0f1d-4e5a-94d4-9590cf5b26a3 req-148ac0fc-c386-4f2e-9b32-de1d8e21b4a6 service nova] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:32 user nova-compute[70709]: DEBUG nova.compute.manager [req-bfba92a9-0f1d-4e5a-94d4-9590cf5b26a3 req-148ac0fc-c386-4f2e-9b32-de1d8e21b4a6 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] No waiting events found dispatching network-vif-plugged-2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:35:32 user nova-compute[70709]: WARNING nova.compute.manager [req-bfba92a9-0f1d-4e5a-94d4-9590cf5b26a3 req-148ac0fc-c386-4f2e-9b32-de1d8e21b4a6 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Received unexpected event network-vif-plugged-2a996a33-f147-4204-8112-588882843b92 for instance with vm_state building and task_state spawning.
Jul 28 00:35:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:34 user nova-compute[70709]: DEBUG nova.compute.manager [req-50a2b75a-fa7e-4557-b689-22238cc8067b req-b96d45bf-431c-4f9b-9e8f-8c2ac335add3 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Received event network-vif-plugged-2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:35:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-50a2b75a-fa7e-4557-b689-22238cc8067b req-b96d45bf-431c-4f9b-9e8f-8c2ac335add3 service nova] Acquiring lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:35:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-50a2b75a-fa7e-4557-b689-22238cc8067b req-b96d45bf-431c-4f9b-9e8f-8c2ac335add3 service nova] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:35:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-50a2b75a-fa7e-4557-b689-22238cc8067b req-b96d45bf-431c-4f9b-9e8f-8c2ac335add3 service nova] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:34 user nova-compute[70709]: DEBUG nova.compute.manager [req-50a2b75a-fa7e-4557-b689-22238cc8067b req-b96d45bf-431c-4f9b-9e8f-8c2ac335add3 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] No waiting events found dispatching network-vif-plugged-2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:35:34 user nova-compute[70709]: WARNING nova.compute.manager [req-50a2b75a-fa7e-4557-b689-22238cc8067b req-b96d45bf-431c-4f9b-9e8f-8c2ac335add3 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Received unexpected event network-vif-plugged-2a996a33-f147-4204-8112-588882843b92 for instance with vm_state building and task_state spawning.
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504535.2314973, ca0ae88f-8b50-48da-b1f6-4358248ccc6c => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:35:35 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] VM Resumed (Lifecycle Event)
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:35:35 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Instance spawned successfully.
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:35:35 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504535.2330098, ca0ae88f-8b50-48da-b1f6-4358248ccc6c => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:35:35 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] VM Started (Lifecycle Event)
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:35:35 user nova-compute[70709]: INFO nova.compute.manager [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Took 5.49 seconds to spawn the instance on the hypervisor.
Jul 28 00:35:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:35:35 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:35:35 user nova-compute[70709]: INFO nova.compute.manager [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Took 19.96 seconds to build instance.
Jul 28 00:35:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-00b86f26-0e32-462e-b583-4061556b9b47 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.075s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:35:35 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:38 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:35:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:35:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:35:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:35:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:35:38 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid aeb18468-b813-42ff-9f27-9fc3bab1aaf2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:35:39 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Updating instance_info_cache with network_info: [{"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:35:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-aeb18468-b813-42ff-9f27-9fc3bab1aaf2" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:35:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:35:40 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 00:35:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 00:35:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:47 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:35:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:35:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-ec6f8bfa-f38a-495f-a3b3-a4207cb611e1 req-9f3ce291-9329-4c19-928e-f37374acca2a service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-changed-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:36:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-ec6f8bfa-f38a-495f-a3b3-a4207cb611e1 req-9f3ce291-9329-4c19-928e-f37374acca2a service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Refreshing instance network info cache due to event network-changed-9a67858a-eecb-4d79-9cc7-c07c11f4eebf. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:36:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ec6f8bfa-f38a-495f-a3b3-a4207cb611e1 req-9f3ce291-9329-4c19-928e-f37374acca2a service nova] Acquiring lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:36:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ec6f8bfa-f38a-495f-a3b3-a4207cb611e1 req-9f3ce291-9329-4c19-928e-f37374acca2a service nova] Acquired lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:36:00 user nova-compute[70709]: DEBUG nova.network.neutron [req-ec6f8bfa-f38a-495f-a3b3-a4207cb611e1 req-9f3ce291-9329-4c19-928e-f37374acca2a service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Refreshing network info cache for port 9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG nova.network.neutron [req-ec6f8bfa-f38a-495f-a3b3-a4207cb611e1 req-9f3ce291-9329-4c19-928e-f37374acca2a service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Updated VIF entry in instance network info cache for port 9a67858a-eecb-4d79-9cc7-c07c11f4eebf. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG nova.network.neutron [req-ec6f8bfa-f38a-495f-a3b3-a4207cb611e1 req-9f3ce291-9329-4c19-928e-f37374acca2a service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Updating instance_info_cache with network_info: [{"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ec6f8bfa-f38a-495f-a3b3-a4207cb611e1 req-9f3ce291-9329-4c19-928e-f37374acca2a service nova] Releasing lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG nova.objects.instance [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lazy-loading 'flavor' on Instance uuid 2b0ebf99-78aa-4492-adee-f75b2330fef9 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:36:01 user nova-compute[70709]: INFO nova.compute.manager [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Attaching volume 70f806aa-8dd4-455f-bb6d-de3110e91949 to /dev/vdb
Jul 28 00:36:01 user nova-compute[70709]: DEBUG os_brick.utils [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f008466-e419-419e-9844-5cbcd892f91f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b50bbb-b4fd-4bcc-9f56-761c1bb254bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c84262-01be-49bb-9c53-5c6f9f8dc967]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4aded6-0d4c-4243-9917-e1163e6a92f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:36:01 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:36:01 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df3b3e6-0722-4cb9-95d5-f652b954be85]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:36:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:36:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:36:02 user nova-compute[70709]: DEBUG os_brick.utils [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:36:02 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Updating existing volume attachment record: cb22b925-ffa2-49af-a789-c4037b9ee6d9 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:36:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-6eccd193-6b19-40ae-9097-b9c6ff1b21e1 req-9bf8c82f-d5e0-4e9e-b2ad-89671e9e7ccf service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received event network-changed-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:36:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-6eccd193-6b19-40ae-9097-b9c6ff1b21e1 req-9bf8c82f-d5e0-4e9e-b2ad-89671e9e7ccf service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Refreshing instance network info cache due to event network-changed-1264a609-d490-4daa-9641-b722999ed799. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:36:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6eccd193-6b19-40ae-9097-b9c6ff1b21e1 req-9bf8c82f-d5e0-4e9e-b2ad-89671e9e7ccf service nova] Acquiring lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:36:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6eccd193-6b19-40ae-9097-b9c6ff1b21e1 req-9bf8c82f-d5e0-4e9e-b2ad-89671e9e7ccf service nova] Acquired lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:36:06 user nova-compute[70709]: DEBUG nova.network.neutron [req-6eccd193-6b19-40ae-9097-b9c6ff1b21e1 req-9bf8c82f-d5e0-4e9e-b2ad-89671e9e7ccf service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Refreshing network info cache for port 1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:36:07 user nova-compute[70709]: DEBUG nova.network.neutron [req-6eccd193-6b19-40ae-9097-b9c6ff1b21e1 req-9bf8c82f-d5e0-4e9e-b2ad-89671e9e7ccf service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Updated VIF entry in instance network info cache for port 1264a609-d490-4daa-9641-b722999ed799. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:36:07 user nova-compute[70709]: DEBUG nova.network.neutron [req-6eccd193-6b19-40ae-9097-b9c6ff1b21e1 req-9bf8c82f-d5e0-4e9e-b2ad-89671e9e7ccf service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Updating instance_info_cache with network_info: [{"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:36:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6eccd193-6b19-40ae-9097-b9c6ff1b21e1 req-9bf8c82f-d5e0-4e9e-b2ad-89671e9e7ccf service nova] Releasing lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:36:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'flavor' on Instance uuid 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:36:08 user nova-compute[70709]: INFO nova.compute.manager [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Attaching volume 99718744-d735-4696-a9c6-0dfbd6dc8c03 to /dev/vdb
Jul 28 00:36:08 user nova-compute[70709]: DEBUG os_brick.utils [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5251f9f2-c557-4b81-83c4-511fdcda98e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf27b21-054e-4823-9f86-1982c7dadf47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47b716e-4c11-49d2-a20a-f1173ae10a39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba4ec31-6001-4e15-ac23-6370a36ccab0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:36:08 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:36:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e54f6e7-1e4f-4161-bee0-f36ce85f633f]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG os_brick.utils [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:36:08 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Updating existing volume attachment record: 7fcc3ff3-6623-43f1-96f9-c245a9fe9aa0 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeiplquG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:36:09 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:36:09 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:36:09 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dbd4b2-f534-4c52-b884-2099c465ba2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:36:09 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[683b1d6b-595c-4250-9f4b-304108e9192c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949] added
Jul 28 00:36:09 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec3e420-b48d-429e-8448-53deb5992826]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3bb596-5bef-4e34-90c3-4453ab7a55f5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SeiplquG {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SeiplquG" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e2bf6a-cec5-4ba2-ad3c-084d0696fbf6]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SeiplquG'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d2d239-2941-4101-8e02-e86f4fa8527f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d82aa06-3a95-4e4e-a036-1cd9f0c69240]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:09 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:09 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:09 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:09 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[99db6a1a-ff8e-4b30-917e-e392894b87fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949, portal: 172.16.0.220,3260]
Jul 28 00:36:09 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949, portal: 172.16.0.220,3260] successful.
Jul 28 00:36:09 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c514eb91-91ce-4bba-b29a-f6145d381dbd]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe342503-382b-47e6-a18e-a81244260a6a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:09 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:09 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:09 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:09 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:09 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:09 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c554df25-7286-45d0-af84-057c8a1ac5a3]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:36:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeiplquG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:36:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:36:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23164326465336630', 'path': '/dev/sdd'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:36:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164326465336630', 'path': '/dev/sdd'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:36:10 user nova-compute[70709]: DEBUG nova.objects.instance [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lazy-loading 'flavor' on Instance uuid 2b0ebf99-78aa-4492-adee-f75b2330fef9 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:36:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:36:10 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:36:10 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:36:10 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:36:10 user nova-compute[70709]:   <serial>70f806aa-8dd4-455f-bb6d-de3110e91949</serial>
Jul 28 00:36:10 user nova-compute[70709]: </disk>
Jul 28 00:36:10 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:36:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:36:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:36:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] No VIF found with MAC fa:16:3e:3e:40:a2, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:36:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c9486948-84c7-4755-8f5a-0b66611acbae tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.895s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:36:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swXAnYbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:36:16 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:36:16 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:36:16 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa3bd9e-07ac-4724-9d72-3221ca19a14c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:36:16 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05aca2c-534e-4d3c-9313-6f542243e9cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03] added
Jul 28 00:36:16 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[978b0409-0c20-4555-8b0e-36fd264725dc]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c968d11a-78aa-4cca-9d51-ab51128bd089]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swXAnYbl {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swXAnYbl" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c27e75-2820-4ab2-b151-342b6ee29405]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'swXAnYbl'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[db79197d-1c4e-4004-84e4-dd1cf75b3265]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[163d49e2-3587-41de-81b3-7c69a1150d39]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d7b2cf-5665-49f0-956a-5a14e85c9d31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03, portal: 172.16.0.220,3260]
Jul 28 00:36:16 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03, portal: 172.16.0.220,3260] successful.
Jul 28 00:36:16 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG nova.objects.instance [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lazy-loading 'flavor' on Instance uuid 2b0ebf99-78aa-4492-adee-f75b2330fef9 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed7f339-82aa-4aa3-ac72-4cc2b0f83a69]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b01f9-d547-455b-8da4-83fdf2aefef3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 (non-flash)
Jul 28 00:36:16 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb218db-fc34-40b1-b9d0-a3442aa16a98]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swXAnYbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:36:16 user nova-compute[70709]: INFO nova.compute.manager [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Attaching volume cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 to /dev/vdc
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.utils [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2b0f95-71aa-40f3-af39-b09a28f85c16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[79afb4ef-7e93-4bb7-84e7-b2fec9a0eb1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09ad134-0319-4b76-bc6c-b9063a566159]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[50229e1f-21f0-4227-b2d0-749ab8a9dca4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:36:16 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:36:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a2adf1-a5ef-4e50-8a55-c9e1294171c2]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG os_brick.utils [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:36:16 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Updating existing volume attachment record: c1a045af-897b-453d-9bf1-01f075dd1657 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:36:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:36:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23931366335613731', 'path': '/dev/sde'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:36:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931366335613731', 'path': '/dev/sde'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:36:17 user nova-compute[70709]: DEBUG nova.objects.instance [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'flavor' on Instance uuid 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:36:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:36:17 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:36:17 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:36:17 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:36:17 user nova-compute[70709]:   <serial>99718744-d735-4696-a9c6-0dfbd6dc8c03</serial>
Jul 28 00:36:17 user nova-compute[70709]: </disk>
Jul 28 00:36:17 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:36:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:36:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:36:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] No VIF found with MAC fa:16:3e:76:06:79, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:36:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-426dabc4-d8e0-4dad-96ac-3f84294a8dfb tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.642s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:36:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:36:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:36:19 user nova-compute[70709]: INFO nova.compute.manager [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Detaching volume 99718744-d735-4696-a9c6-0dfbd6dc8c03
Jul 28 00:36:19 user nova-compute[70709]: INFO nova.virt.block_device [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Attempting to driver detach volume 99718744-d735-4696-a9c6-0dfbd6dc8c03 from mountpoint /dev/vdb
Jul 28 00:36:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Attempting to detach device vdb from instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:36:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:36:19 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:36:19 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:36:19 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:36:19 user nova-compute[70709]:   <serial>99718744-d735-4696-a9c6-0dfbd6dc8c03</serial>
Jul 28 00:36:19 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:36:19 user nova-compute[70709]: </disk>
Jul 28 00:36:19 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:36:19 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Successfully detached device vdb from instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb from the persistent domain config.
Jul 28 00:36:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:36:19 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:36:19 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:36:19 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:36:19 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:36:19 user nova-compute[70709]:   <serial>99718744-d735-4696-a9c6-0dfbd6dc8c03</serial>
Jul 28 00:36:19 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:36:19 user nova-compute[70709]: </disk>
Jul 28 00:36:19 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504580.3150394, 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:36:20 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Successfully detached device vdb from instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb from the live domain config.
Jul 28 00:36:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swXAnYbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:36:20 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d4d884-456a-4a94-acd9-cf7119233167]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:36:20 user nova-compute[70709]: No targets found.
Jul 28 00:36:20 user nova-compute[70709]: iSNS:
Jul 28 00:36:20 user nova-compute[70709]: No targets found.
Jul 28 00:36:20 user nova-compute[70709]: STATIC:
Jul 28 00:36:20 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03
Jul 28 00:36:20 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:36:20 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:36:20 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6
Jul 28 00:36:20 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:36:20 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:36:20 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2
Jul 28 00:36:20 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:36:20 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:36:20 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949
Jul 28 00:36:20 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:36:20 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:36:20 user nova-compute[70709]: FIRMWARE:
Jul 28 00:36:20 user nova-compute[70709]: No targets found.
Jul 28 00:36:20 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:36:20 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:36:20 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[503da061-18a7-48b9-b511-92efb6869532]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[85601b8a-6d89-4fe1-a745-25f89881384e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:20 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:20 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:20 user nova-compute[70709]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 (non-flash)
Jul 28 00:36:20 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:20 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:20 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:20 user nova-compute[70709]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 (non-flash)
Jul 28 00:36:20 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b88381870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03'): ({'sde'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Removing single pathed devices sde {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7491c065-3369-41bd-9b10-78a851e1b5f1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d70a81e-69ad-4749-b727-a1e549f6e8de]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Flushing IO for device /dev/sde {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f02f03-8e2e-483e-8fed-06c7555bf0f3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b555f1-c200-4234-bdf6-892422a2006a]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c300fa1-43bc-4f5c-a8a5-2481171c98d8]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e359b17d-abb4-48a3-b630-d8fd25c29fc7]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03, portal: 172.16.0.220,3260]
Jul 28 00:36:20 user nova-compute[70709]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03, portal: 172.16.0.220,3260] successful.
Jul 28 00:36:20 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99718744-d735-4696-a9c6-0dfbd6dc8c03 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[97117cf5-e3c1-4999-be3a-006aaeb80df2]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] <== disconnect_volume: return (323ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:36:20 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:36:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:21 user nova-compute[70709]: DEBUG nova.objects.instance [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'flavor' on Instance uuid 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:36:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d361ccff-7f09-4bdb-8776-c277236f18f9 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:36:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTGdvtYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:36:24 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:36:24 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:36:24 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f72b15-55ff-4500-83b9-11778a50450d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:36:24 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[75218407-a82f-4746-90ec-ae31546cbaa7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0] added
Jul 28 00:36:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e350914-ed23-4546-aaaf-dd0978799e0c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d39df5-02c5-4369-b42f-4ff507cb77d7]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTGdvtYX {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTGdvtYX" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d94f0c-a1dc-4380-8b3b-51be68797826]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yTGdvtYX'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbc22e3-f6f4-48ec-a697-ec3320fb5bfb]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ca3638-b03c-4150-a3f1-d6c3ed99e227]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36ced52-de4f-49c4-a374-0a74f393e39f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0, portal: 172.16.0.220,3260]
Jul 28 00:36:24 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0, portal: 172.16.0.220,3260] successful.
Jul 28 00:36:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecba07c5-c2c3-43fa-9754-e08f51c51035]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b79f7f-0e28-4de9-9d17-9aa7e3548f84]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 (non-flash)
Jul 28 00:36:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[588a8fcb-ddcc-40d2-b0ba-aac037330e0d]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:36:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTGdvtYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23538383734376561', 'path': '/dev/sde'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538383734376561', 'path': '/dev/sde'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG nova.objects.instance [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lazy-loading 'flavor' on Instance uuid 2b0ebf99-78aa-4492-adee-f75b2330fef9 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:36:25 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:36:25 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:36:25 user nova-compute[70709]:   <target dev="vdc" bus="virtio"/>
Jul 28 00:36:25 user nova-compute[70709]:   <serial>cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0</serial>
Jul 28 00:36:25 user nova-compute[70709]: </disk>
Jul 28 00:36:25 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] No VIF found with MAC fa:16:3e:3e:40:a2, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-631c9740-979c-4daa-adef-27f9bed2db52 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.159s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:36:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:36:26 user nova-compute[70709]: INFO nova.compute.manager [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Detaching volume cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:26 user nova-compute[70709]: INFO nova.virt.block_device [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Attempting to driver detach volume cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 from mountpoint /dev/vdc
Jul 28 00:36:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Attempting to detach device vdc from instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:36:26 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:36:26 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:36:26 user nova-compute[70709]:   <target dev="vdc" bus="virtio"/>
Jul 28 00:36:26 user nova-compute[70709]:   <serial>cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0</serial>
Jul 28 00:36:26 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 28 00:36:26 user nova-compute[70709]: </disk>
Jul 28 00:36:26 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:36:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Successfully detached device vdc from instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 from the persistent domain config.
Jul 28 00:36:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:36:26 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:36:26 user nova-compute[70709]:   <source dev="/dev/sde"/>
Jul 28 00:36:26 user nova-compute[70709]:   <target dev="vdc" bus="virtio"/>
Jul 28 00:36:26 user nova-compute[70709]:   <serial>cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0</serial>
Jul 28 00:36:26 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 28 00:36:26 user nova-compute[70709]: </disk>
Jul 28 00:36:26 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504587.197251, 2b0ebf99-78aa-4492-adee-f75b2330fef9 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:36:27 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Successfully detached device vdc from instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 from the live domain config.
Jul 28 00:36:27 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:36:27 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8067MB free_disk=25.296001434326172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTGdvtYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:36:27 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a566ccaf-6365-490f-acc4-cf555f48835a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:36:27 user nova-compute[70709]: No targets found.
Jul 28 00:36:27 user nova-compute[70709]: iSNS:
Jul 28 00:36:27 user nova-compute[70709]: No targets found.
Jul 28 00:36:27 user nova-compute[70709]: STATIC:
Jul 28 00:36:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6
Jul 28 00:36:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:36:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:36:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0
Jul 28 00:36:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:36:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:36:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2
Jul 28 00:36:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:36:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:36:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949
Jul 28 00:36:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:36:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:36:27 user nova-compute[70709]: FIRMWARE:
Jul 28 00:36:27 user nova-compute[70709]: No targets found.
Jul 28 00:36:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:36:27 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:36:27 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[83342b8e-fe51-46d7-bdbe-40cf803ac0c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a17c9d-8691-4a11-b339-95752e94741f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:27 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:27 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:27 user nova-compute[70709]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 (non-flash)
Jul 28 00:36:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:36:27 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:36:27 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:36:27 user nova-compute[70709]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 (non-flash)
Jul 28 00:36:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90396a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0'): ({'sde'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Removing single pathed devices sde {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance aeb18468-b813-42ff-9f27-9fc3bab1aaf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance ca0ae88f-8b50-48da-b1f6-4358248ccc6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c32668-3720-47d3-8fe5-3abc852b4220]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aced26f-4bf6-4fda-8a95-9951f477e5b6]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Flushing IO for device /dev/sde {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b76072-657d-497d-9811-22896aff1838]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdae17c-eaf2-48c6-9dea-b1047357f18c]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] SCSI volumes sde have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ef9481-f69b-4794-9dfa-ce520434d703]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:27 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8832897-e129-44d0-b74d-e29cc71aa6d6]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0, portal: 172.16.0.220,3260]
Jul 28 00:36:28 user nova-compute[70709]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0, portal: 172.16.0.220,3260] successful.
Jul 28 00:36:28 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb5ba17-30b3-4ec0-9eff-ef47bf587ed0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4714ab0-30ba-47f6-9672-b3d35adb60e4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] <== disconnect_volume: return (315ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.915s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG nova.objects.instance [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lazy-loading 'flavor' on Instance uuid 2b0ebf99-78aa-4492-adee-f75b2330fef9 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:36:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-82fe0ecb-9224-48f3-adda-c45e20789f37 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.015s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:36:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:36:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:36:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:36:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:36:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:36:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:36:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:36:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:36 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:36:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:36:40 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:36:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:36:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:36:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:36:40 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:36:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:41 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Updating instance_info_cache with network_info: [{"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:36:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-2b0ebf99-78aa-4492-adee-f75b2330fef9" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:36:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:36:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:36:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:37:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:02 user nova-compute[70709]: INFO nova.compute.manager [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Rescuing
Jul 28 00:37:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:37:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquired lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:37:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:37:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updating instance_info_cache with network_info: [{"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:37:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Releasing lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:37:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-1c9fe218-16cf-4e7f-89c2-0d89395d3d3a req-f1b61eff-8e74-426c-884c-7b4339e88934 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received event network-vif-unplugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:37:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1c9fe218-16cf-4e7f-89c2-0d89395d3d3a req-f1b61eff-8e74-426c-884c-7b4339e88934 service nova] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1c9fe218-16cf-4e7f-89c2-0d89395d3d3a req-f1b61eff-8e74-426c-884c-7b4339e88934 service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1c9fe218-16cf-4e7f-89c2-0d89395d3d3a req-f1b61eff-8e74-426c-884c-7b4339e88934 service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-1c9fe218-16cf-4e7f-89c2-0d89395d3d3a req-f1b61eff-8e74-426c-884c-7b4339e88934 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] No waiting events found dispatching network-vif-unplugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:37:02 user nova-compute[70709]: WARNING nova.compute.manager [req-1c9fe218-16cf-4e7f-89c2-0d89395d3d3a req-f1b61eff-8e74-426c-884c-7b4339e88934 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received unexpected event network-vif-unplugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 for instance with vm_state active and task_state rescuing.
Jul 28 00:37:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Instance destroyed successfully.
Jul 28 00:37:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Attempting rescue
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70709) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Instance directory exists: not creating {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 28 00:37:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Creating image(s)
Jul 28 00:37:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4d016cd1-fe5e-4ec9-9105-5450d99c9599 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue" returned: 0 in 0.050s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'migration_context' on Instance uuid 4d016cd1-fe5e-4ec9-9105-5450d99c9599 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Start _get_guest_xml network_info=[{"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "vif_mac": "fa:16:3e:d5:7d:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'resources' on Instance uuid 4d016cd1-fe5e-4ec9-9105-5450d99c9599 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d016cd1-fe5e-4ec9-9105-5450d99c9599 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:37:03 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:37:03 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4d016cd1-fe5e-4ec9-9105-5450d99c9599 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1655829224',display_name='tempest-ServerRescueNegativeTestJSON-server-1655829224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1655829224',id=41,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:35:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-iqt1ls02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:35:20Z,user_data=None,user_id='d8afed76354148e290f0b4f602616818',uuid=4d016cd1-fe5e-4ec9-9105-5450d99c9599,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "vif_mac": "fa:16:3e:d5:7d:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "vif_mac": "fa:16:3e:d5:7d:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:7d:fd,bridge_name='br-int',has_traffic_filtering=True,id=d9ae9215-f02d-4969-ba43-f7ae789ad860,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae9215-f0') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d016cd1-fe5e-4ec9-9105-5450d99c9599 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:37:03 user nova-compute[70709]:   <uuid>4d016cd1-fe5e-4ec9-9105-5450d99c9599</uuid>
Jul 28 00:37:03 user nova-compute[70709]:   <name>instance-00000029</name>
Jul 28 00:37:03 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:37:03 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:37:03 user nova-compute[70709]:   <metadata>
Jul 28 00:37:03 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:37:03 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:37:03 user nova-compute[70709]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1655829224</nova:name>
Jul 28 00:37:03 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:37:03</nova:creationTime>
Jul 28 00:37:03 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:37:03 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:37:03 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:37:03 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:37:03 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:37:03 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:37:03 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:37:03 user nova-compute[70709]:       <nova:owner>
Jul 28 00:37:03 user nova-compute[70709]:         <nova:user uuid="d8afed76354148e290f0b4f602616818">tempest-ServerRescueNegativeTestJSON-1040689578-project-member</nova:user>
Jul 28 00:37:03 user nova-compute[70709]:         <nova:project uuid="ad38eeba09ce4551899f892ea787ea1c">tempest-ServerRescueNegativeTestJSON-1040689578</nova:project>
Jul 28 00:37:03 user nova-compute[70709]:       </nova:owner>
Jul 28 00:37:03 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:37:03 user nova-compute[70709]:       <nova:ports>
Jul 28 00:37:03 user nova-compute[70709]:         <nova:port uuid="d9ae9215-f02d-4969-ba43-f7ae789ad860">
Jul 28 00:37:03 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 28 00:37:03 user nova-compute[70709]:         </nova:port>
Jul 28 00:37:03 user nova-compute[70709]:       </nova:ports>
Jul 28 00:37:03 user nova-compute[70709]:     </nova:instance>
Jul 28 00:37:03 user nova-compute[70709]:   </metadata>
Jul 28 00:37:03 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:37:03 user nova-compute[70709]:     <system>
Jul 28 00:37:03 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:37:03 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:37:03 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:37:03 user nova-compute[70709]:       <entry name="serial">4d016cd1-fe5e-4ec9-9105-5450d99c9599</entry>
Jul 28 00:37:03 user nova-compute[70709]:       <entry name="uuid">4d016cd1-fe5e-4ec9-9105-5450d99c9599</entry>
Jul 28 00:37:03 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:37:03 user nova-compute[70709]:     </system>
Jul 28 00:37:03 user nova-compute[70709]:   </sysinfo>
Jul 28 00:37:03 user nova-compute[70709]:   <os>
Jul 28 00:37:03 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:37:03 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:37:03 user nova-compute[70709]:   </os>
Jul 28 00:37:03 user nova-compute[70709]:   <features>
Jul 28 00:37:03 user nova-compute[70709]:     <acpi/>
Jul 28 00:37:03 user nova-compute[70709]:     <apic/>
Jul 28 00:37:03 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:37:03 user nova-compute[70709]:   </features>
Jul 28 00:37:03 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:37:03 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:37:03 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:37:03 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:37:03 user nova-compute[70709]:   </clock>
Jul 28 00:37:03 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:37:03 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:37:03 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:37:03 user nova-compute[70709]:   </cpu>
Jul 28 00:37:03 user nova-compute[70709]:   <devices>
Jul 28 00:37:03 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:37:03 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:37:03 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue"/>
Jul 28 00:37:03 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:37:03 user nova-compute[70709]:     </disk>
Jul 28 00:37:03 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:37:03 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:37:03 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk"/>
Jul 28 00:37:03 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:37:03 user nova-compute[70709]:     </disk>
Jul 28 00:37:03 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:37:03 user nova-compute[70709]:       <mac address="fa:16:3e:d5:7d:fd"/>
Jul 28 00:37:03 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:37:03 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:37:03 user nova-compute[70709]:       <target dev="tapd9ae9215-f0"/>
Jul 28 00:37:03 user nova-compute[70709]:     </interface>
Jul 28 00:37:03 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:37:03 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/console.log" append="off"/>
Jul 28 00:37:03 user nova-compute[70709]:     </serial>
Jul 28 00:37:03 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:37:03 user nova-compute[70709]:     <video>
Jul 28 00:37:03 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:37:03 user nova-compute[70709]:     </video>
Jul 28 00:37:03 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:37:03 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:37:03 user nova-compute[70709]:     </rng>
Jul 28 00:37:03 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:37:03 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:37:03 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:37:03 user nova-compute[70709]:     </memballoon>
Jul 28 00:37:03 user nova-compute[70709]:   </devices>
Jul 28 00:37:03 user nova-compute[70709]: </domain>
Jul 28 00:37:03 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:37:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Instance destroyed successfully.
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:37:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No VIF found with MAC fa:16:3e:d5:7d:fd, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:37:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-84b95d08-abd4-4cd0-b15f-3ff96ba73cb3 req-bd8a5078-8b3b-4c9c-9e28-bea5f1444455 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:37:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-84b95d08-abd4-4cd0-b15f-3ff96ba73cb3 req-bd8a5078-8b3b-4c9c-9e28-bea5f1444455 service nova] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-84b95d08-abd4-4cd0-b15f-3ff96ba73cb3 req-bd8a5078-8b3b-4c9c-9e28-bea5f1444455 service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-84b95d08-abd4-4cd0-b15f-3ff96ba73cb3 req-bd8a5078-8b3b-4c9c-9e28-bea5f1444455 service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-84b95d08-abd4-4cd0-b15f-3ff96ba73cb3 req-bd8a5078-8b3b-4c9c-9e28-bea5f1444455 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] No waiting events found dispatching network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:37:05 user nova-compute[70709]: WARNING nova.compute.manager [req-84b95d08-abd4-4cd0-b15f-3ff96ba73cb3 req-bd8a5078-8b3b-4c9c-9e28-bea5f1444455 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received unexpected event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 for instance with vm_state active and task_state rescuing.
Jul 28 00:37:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-8b0a7a5a-1ec4-4fe5-9a19-2df593237b41 req-d96bf6c2-b668-4c5a-be0c-c4848e875000 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Received event network-changed-2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:37:06 user nova-compute[70709]: DEBUG nova.compute.manager [req-8b0a7a5a-1ec4-4fe5-9a19-2df593237b41 req-d96bf6c2-b668-4c5a-be0c-c4848e875000 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Refreshing instance network info cache due to event network-changed-2a996a33-f147-4204-8112-588882843b92. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:37:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8b0a7a5a-1ec4-4fe5-9a19-2df593237b41 req-d96bf6c2-b668-4c5a-be0c-c4848e875000 service nova] Acquiring lock "refresh_cache-ca0ae88f-8b50-48da-b1f6-4358248ccc6c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:37:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8b0a7a5a-1ec4-4fe5-9a19-2df593237b41 req-d96bf6c2-b668-4c5a-be0c-c4848e875000 service nova] Acquired lock "refresh_cache-ca0ae88f-8b50-48da-b1f6-4358248ccc6c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:37:06 user nova-compute[70709]: DEBUG nova.network.neutron [req-8b0a7a5a-1ec4-4fe5-9a19-2df593237b41 req-d96bf6c2-b668-4c5a-be0c-c4848e875000 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Refreshing network info cache for port 2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.network.neutron [req-8b0a7a5a-1ec4-4fe5-9a19-2df593237b41 req-d96bf6c2-b668-4c5a-be0c-c4848e875000 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Updated VIF entry in instance network info cache for port 2a996a33-f147-4204-8112-588882843b92. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.network.neutron [req-8b0a7a5a-1ec4-4fe5-9a19-2df593237b41 req-d96bf6c2-b668-4c5a-be0c-c4848e875000 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Updating instance_info_cache with network_info: [{"id": "2a996a33-f147-4204-8112-588882843b92", "address": "fa:16:3e:2d:96:25", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a996a33-f1", "ovs_interfaceid": "2a996a33-f147-4204-8112-588882843b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] No waiting events found dispatching network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:37:07 user nova-compute[70709]: WARNING nova.compute.manager [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received unexpected event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 for instance with vm_state active and task_state rescuing.
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] No waiting events found dispatching network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:37:07 user nova-compute[70709]: WARNING nova.compute.manager [req-010be7c0-5eba-4be9-9971-29c46018a8e2 req-c197e60a-150c-4114-9f99-4cc78a3ef4cd service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received unexpected event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 for instance with vm_state active and task_state rescuing.
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8b0a7a5a-1ec4-4fe5-9a19-2df593237b41 req-d96bf6c2-b668-4c5a-be0c-c4848e875000 service nova] Releasing lock "refresh_cache-ca0ae88f-8b50-48da-b1f6-4358248ccc6c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:07 user nova-compute[70709]: INFO nova.compute.manager [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Terminating instance
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for 4d016cd1-fe5e-4ec9-9105-5450d99c9599 due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504627.153975, 4d016cd1-fe5e-4ec9-9105-5450d99c9599 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:37:07 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] VM Resumed (Lifecycle Event)
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e499f783-9c30-4633-8fa2-c2706db68de5 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:07 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504627.1557422, 4d016cd1-fe5e-4ec9-9105-5450d99c9599 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:37:07 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] VM Started (Lifecycle Event)
Jul 28 00:37:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:07 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Instance destroyed successfully.
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.objects.instance [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'resources' on Instance uuid ca0ae88f-8b50-48da-b1f6-4358248ccc6c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-204948545',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-204948545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-204948545',id=42,image_ref='a1433ad4-0e2d-4259-a60c-1767392ca9a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJdFXBBG8Km0R7bavbQPOaK3NRiBPwuiNjSbmcoL5C1r63tGGaR8QTmVr6uIsJCyx7eblCVLWvztKqiU2MWf0SNIhT/fcaCUzUHps6TY2SKDobRhLs28r8iAoWt21R66w==',key_name='tempest-keypair-136906390',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-ed7x7ps0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2090046407',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d994eb215f204b029d183b73539e3d4d',uuid=ca0ae88f-8b50-48da-b1f6-4358248ccc6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a996a33-f147-4204-8112-588882843b92", "address": "fa:16:3e:2d:96:25", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a996a33-f1", "ovs_interfaceid": "2a996a33-f147-4204-8112-588882843b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "2a996a33-f147-4204-8112-588882843b92", "address": "fa:16:3e:2d:96:25", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a996a33-f1", "ovs_interfaceid": "2a996a33-f147-4204-8112-588882843b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:96:25,bridge_name='br-int',has_traffic_filtering=True,id=2a996a33-f147-4204-8112-588882843b92,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a996a33-f1') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG os_vif [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:96:25,bridge_name='br-int',has_traffic_filtering=True,id=2a996a33-f147-4204-8112-588882843b92,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a996a33-f1') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a996a33-f1, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:37:07 user nova-compute[70709]: INFO os_vif [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:96:25,bridge_name='br-int',has_traffic_filtering=True,id=2a996a33-f147-4204-8112-588882843b92,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a996a33-f1')
Jul 28 00:37:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNstzMiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:37:07 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:37:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[049a812e-d0fd-4a4f-a724-48db2ae8b608]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:37:07 user nova-compute[70709]: No targets found.
Jul 28 00:37:07 user nova-compute[70709]: iSNS:
Jul 28 00:37:07 user nova-compute[70709]: No targets found.
Jul 28 00:37:07 user nova-compute[70709]: STATIC:
Jul 28 00:37:07 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6
Jul 28 00:37:07 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:37:07 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:37:07 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2
Jul 28 00:37:07 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:37:07 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:37:07 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949
Jul 28 00:37:07 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:37:07 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:37:07 user nova-compute[70709]: FIRMWARE:
Jul 28 00:37:07 user nova-compute[70709]: No targets found.
Jul 28 00:37:07 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:37:07 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:37:07 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3917e8c-685e-4e64-be28-abafcd6e3cce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0f8284-5aec-4930-b4ce-8c5d58e8e069]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:37:08 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:37:08 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:37:08 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:37:08 user nova-compute[70709]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 (non-flash)
Jul 28 00:37:08 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:37:08 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b883820e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2'): ({'sdc'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Removing single pathed devices sdc {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85a1ae8-fd44-4789-85dd-dd6b0e3a5c77]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[029aa4ec-76de-4225-8437-70f4a5b839a4]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flushing IO for device /dev/sdc {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5460abcc-78df-4766-9c35-d5f4fe2779fa]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[963ed9c5-88e0-4f2f-9b75-346c91fd0eb2]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cca55b-0a13-45f4-ae15-b94d3413e24f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f871d297-be44-4a41-9395-492da6e9a0fa]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2, portal: 172.16.0.220,3260]
Jul 28 00:37:08 user nova-compute[70709]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2, portal: 172.16.0.220,3260] successful.
Jul 28 00:37:08 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c669e8-9c40-4c80-be3f-ba3710488db2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc2522b-8524-487a-b1e9-0d4da7457abf]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== disconnect_volume: return (350ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:37:08 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Deleting instance files /opt/stack/data/nova/instances/ca0ae88f-8b50-48da-b1f6-4358248ccc6c_del
Jul 28 00:37:08 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Deletion of /opt/stack/data/nova/instances/ca0ae88f-8b50-48da-b1f6-4358248ccc6c_del complete
Jul 28 00:37:08 user nova-compute[70709]: INFO nova.compute.manager [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Received event network-vif-unplugged-2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] Acquiring lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] No waiting events found dispatching network-vif-unplugged-2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Received event network-vif-unplugged-2a996a33-f147-4204-8112-588882843b92 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Received event network-vif-plugged-2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] Acquiring lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] No waiting events found dispatching network-vif-plugged-2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:37:08 user nova-compute[70709]: WARNING nova.compute.manager [req-aeba24cd-b433-409e-9022-b7616d534882 req-757be7cc-ee77-4220-a986-d6d89f50d794 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Received unexpected event network-vif-plugged-2a996a33-f147-4204-8112-588882843b92 for instance with vm_state active and task_state deleting.
Jul 28 00:37:09 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:37:09 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Took 0.90 seconds to deallocate network for instance.
Jul 28 00:37:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-ecdabc23-e39c-4221-a524-c624414e378e req-45e74707-24b3-4222-b927-7fdff7a327e7 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Received event network-vif-deleted-2a996a33-f147-4204-8112-588882843b92 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:37:09 user nova-compute[70709]: INFO nova.compute.manager [req-ecdabc23-e39c-4221-a524-c624414e378e req-45e74707-24b3-4222-b927-7fdff7a327e7 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Neutron deleted interface 2a996a33-f147-4204-8112-588882843b92; detaching it from the instance and deleting it from the info cache
Jul 28 00:37:09 user nova-compute[70709]: DEBUG nova.network.neutron [req-ecdabc23-e39c-4221-a524-c624414e378e req-45e74707-24b3-4222-b927-7fdff7a327e7 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:37:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-ecdabc23-e39c-4221-a524-c624414e378e req-45e74707-24b3-4222-b927-7fdff7a327e7 service nova] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Detach interface failed, port_id=2a996a33-f147-4204-8112-588882843b92, reason: Instance ca0ae88f-8b50-48da-b1f6-4358248ccc6c could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:37:10 user nova-compute[70709]: INFO nova.compute.manager [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Took 0.85 seconds to detach 1 volumes for instance.
Jul 28 00:37:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Deleting volume: 44c669e8-9c40-4c80-be3f-ba3710488db2 {{(pid=70709) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 28 00:37:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:10 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:37:10 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:37:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:10 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Deleted allocations for instance ca0ae88f-8b50-48da-b1f6-4358248ccc6c
Jul 28 00:37:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0aaeed90-0ea3-438b-bfe4-47115a796f66 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "ca0ae88f-8b50-48da-b1f6-4358248ccc6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.503s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:16 user nova-compute[70709]: DEBUG nova.compute.manager [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:37:16 user nova-compute[70709]: INFO nova.compute.manager [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] instance snapshotting
Jul 28 00:37:16 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Beginning live snapshot process
Jul 28 00:37:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json -f qcow2 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json -f qcow2 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvcqz3d71/ba875c256aa34f8d86cb37138969fabb.delta 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvcqz3d71/ba875c256aa34f8d86cb37138969fabb.delta 1073741824" returned: 0 in 0.050s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:17 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 28 00:37:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:17 user nova-compute[70709]: INFO nova.compute.manager [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Detaching volume 70f806aa-8dd4-455f-bb6d-de3110e91949
Jul 28 00:37:17 user nova-compute[70709]: INFO nova.virt.block_device [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Attempting to driver detach volume 70f806aa-8dd4-455f-bb6d-de3110e91949 from mountpoint /dev/vdb
Jul 28 00:37:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Attempting to detach device vdb from instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:37:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:37:17 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:37:17 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:37:17 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:37:17 user nova-compute[70709]:   <serial>70f806aa-8dd4-455f-bb6d-de3110e91949</serial>
Jul 28 00:37:17 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:37:17 user nova-compute[70709]: </disk>
Jul 28 00:37:17 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:37:17 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Successfully detached device vdb from instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 from the persistent domain config.
Jul 28 00:37:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:37:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:37:17 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:37:17 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:37:17 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:37:17 user nova-compute[70709]:   <serial>70f806aa-8dd4-455f-bb6d-de3110e91949</serial>
Jul 28 00:37:17 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:37:17 user nova-compute[70709]: </disk>
Jul 28 00:37:17 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:37:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:37:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504638.0837035, 2b0ebf99-78aa-4492-adee-f75b2330fef9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:37:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Successfully detached device vdb from instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 from the live domain config.
Jul 28 00:37:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeiplquG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:37:18 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c33483-0147-492e-8967-619dd1614db5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:37:18 user nova-compute[70709]: No targets found.
Jul 28 00:37:18 user nova-compute[70709]: iSNS:
Jul 28 00:37:18 user nova-compute[70709]: No targets found.
Jul 28 00:37:18 user nova-compute[70709]: STATIC:
Jul 28 00:37:18 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6
Jul 28 00:37:18 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:37:18 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:37:18 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949
Jul 28 00:37:18 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:37:18 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:37:18 user nova-compute[70709]: FIRMWARE:
Jul 28 00:37:18 user nova-compute[70709]: No targets found.
Jul 28 00:37:18 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:37:18 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:37:18 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fd74f1-add4-49c6-b36c-08bc97157cdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10964d9-6d23-4f1d-b2d3-06537e7c9272]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:37:18 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:37:18 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:37:18 user nova-compute[70709]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 (non-flash)
Jul 28 00:37:18 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b88377a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949'): ({'sdd'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Removing single pathed devices sdd {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1540f79b-7ad9-44c8-a5c9-f4070e7d9832]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[111770e1-31eb-4250-b888-43b7f10e8635]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Flushing IO for device /dev/sdd {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f279d92-4e58-44bc-b526-739213c85e9e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[57238ef3-438c-451d-9e92-26905a62304e]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70709) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 28 00:37:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9191d4b-cbda-4c8e-8ce2-8245140f945e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab01c34-b83e-4558-86b1-09b8e357f386]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949, portal: 172.16.0.220,3260]
Jul 28 00:37:18 user nova-compute[70709]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949, portal: 172.16.0.220,3260] successful.
Jul 28 00:37:18 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f806aa-8dd4-455f-bb6d-de3110e91949 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a527f836-cfe7-432d-8b52-9a86d9a09701]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] <== disconnect_volume: return (315ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:37:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvcqz3d71/ba875c256aa34f8d86cb37138969fabb.delta /opt/stack/data/nova/instances/snapshots/tmpvcqz3d71/ba875c256aa34f8d86cb37138969fabb {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvcqz3d71/ba875c256aa34f8d86cb37138969fabb.delta /opt/stack/data/nova/instances/snapshots/tmpvcqz3d71/ba875c256aa34f8d86cb37138969fabb" returned: 0 in 0.574s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:19 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Snapshot extracted, beginning image upload
Jul 28 00:37:19 user nova-compute[70709]: DEBUG nova.objects.instance [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lazy-loading 'flavor' on Instance uuid 2b0ebf99-78aa-4492-adee-f75b2330fef9 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:37:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d40bd4a8-8faf-4ceb-a113-d8b6296b402d tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.097s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:21 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Snapshot image upload complete
Jul 28 00:37:21 user nova-compute[70709]: INFO nova.compute.manager [None req-fd63f398-53ec-4001-83fb-f345b2030fc0 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Took 5.02 seconds to snapshot the instance on the hypervisor.
Jul 28 00:37:22 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:37:22 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504627.8680694, ca0ae88f-8b50-48da-b1f6-4358248ccc6c => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:37:22 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] VM Stopped (Lifecycle Event)
Jul 28 00:37:22 user nova-compute[70709]: DEBUG nova.compute.manager [None req-a437ddb7-9ba0-4b6f-8171-f467c15441c0 None None] [instance: ca0ae88f-8b50-48da-b1f6-4358248ccc6c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:37:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:37:23 user nova-compute[70709]: INFO nova.compute.claims [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Claim successful on node user
Jul 28 00:37:23 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:37:23 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:37:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG nova.policy [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4f5d7ab7bc9485da7b82444b9bd4d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda75c307259403282f8d98700806f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:37:23 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Creating image(s)
Jul 28 00:37:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "/opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "/opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "/opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "e84a4becce58e5376ed2db9ab77c606f376a1c3a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "e84a4becce58e5376ed2db9ab77c606f376a1c3a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a.part --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:24 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Successfully created port: e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a.part --force-share --output=json" returned: 0 in 0.162s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG nova.virt.images [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] 6cbe13b4-6491-4101-bda9-f8573bb243db was qcow2, converting to raw {{(pid=70709) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a.part /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a.converted {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a.part /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a.converted" returned: 0 in 0.581s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a.converted --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Successfully updated port: e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-f51f7fcd-619c-4a4c-8c77-78376bfc5a16 req-858a2e09-e8b3-496e-9814-0f1c3b751421 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received event network-changed-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-f51f7fcd-619c-4a4c-8c77-78376bfc5a16 req-858a2e09-e8b3-496e-9814-0f1c3b751421 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Refreshing instance network info cache due to event network-changed-e60f73f2-f87f-4b47-acbd-78ec506ba37e. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f51f7fcd-619c-4a4c-8c77-78376bfc5a16 req-858a2e09-e8b3-496e-9814-0f1c3b751421 service nova] Acquiring lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f51f7fcd-619c-4a4c-8c77-78376bfc5a16 req-858a2e09-e8b3-496e-9814-0f1c3b751421 service nova] Acquired lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG nova.network.neutron [req-f51f7fcd-619c-4a4c-8c77-78376bfc5a16 req-858a2e09-e8b3-496e-9814-0f1c3b751421 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Refreshing network info cache for port e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "e84a4becce58e5376ed2db9ab77c606f376a1c3a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.168s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.network.neutron [req-f51f7fcd-619c-4a4c-8c77-78376bfc5a16 req-858a2e09-e8b3-496e-9814-0f1c3b751421 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a --force-share --output=json" returned: 0 in 0.150s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "e84a4becce58e5376ed2db9ab77c606f376a1c3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "e84a4becce58e5376ed2db9ab77c606f376a1c3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a,backing_fmt=raw /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a,backing_fmt=raw /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk 1073741824" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "e84a4becce58e5376ed2db9ab77c606f376a1c3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.network.neutron [req-f51f7fcd-619c-4a4c-8c77-78376bfc5a16 req-858a2e09-e8b3-496e-9814-0f1c3b751421 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f51f7fcd-619c-4a4c-8c77-78376bfc5a16 req-858a2e09-e8b3-496e-9814-0f1c3b751421 service nova] Releasing lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquired lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a --force-share --output=json" returned: 0 in 0.156s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.objects.instance [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'migration_context' on Instance uuid 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Ensure instance console log exists: /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Updating instance_info_cache with network_info: [{"id": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "address": "fa:16:3e:d1:21:94", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60f73f2-f8", "ovs_interfaceid": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Releasing lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Instance network_info: |[{"id": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "address": "fa:16:3e:d1:21:94", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60f73f2-f8", "ovs_interfaceid": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Start _get_guest_xml network_info=[{"id": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "address": "fa:16:3e:d1:21:94", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60f73f2-f8", "ovs_interfaceid": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4b55e9e1d766624f016572b080f651b2',container_format='bare',created_at=2023-07-28T00:37:16Z,direct_url=<?>,disk_format='qcow2',id=6cbe13b4-6491-4101-bda9-f8573bb243db,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-828341586',owner='cda75c307259403282f8d98700806f24',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-28T00:37:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '6cbe13b4-6491-4101-bda9-f8573bb243db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:37:26 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:37:26 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4b55e9e1d766624f016572b080f651b2',container_format='bare',created_at=2023-07-28T00:37:16Z,direct_url=<?>,disk_format='qcow2',id=6cbe13b4-6491-4101-bda9-f8573bb243db,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-828341586',owner='cda75c307259403282f8d98700806f24',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-28T00:37:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-355782394',display_name='tempest-TestStampPattern-server-355782394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-355782394',id=43,image_ref='6cbe13b4-6491-4101-bda9-f8573bb243db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbIsegpiueygcqxDMoqSRPiFzCAnNCeyeO9o7pyraW7IRIG5BvGlYKQLMkQxKgoyxaQdPTaJ/Hf8m0otg97bnUyVJ7NJ5OuhJ+tpoBcvNHMqX4UEk5LyzatE/ojR/Gr9A==',key_name='tempest-TestStampPattern-1821279517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cda75c307259403282f8d98700806f24',ramdisk_id='',reservation_id='r-ci6x3fcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0f2efeca-74ee-4d4b-a591-8cd8298d7ceb',image_min_disk='1',image_min_ram='0',image_owner_id='cda75c307259403282f8d98700806f24',image_owner_project_name='tempest-TestStampPattern-734847133',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-734847133-project-member',image_user_id='c4f5d7ab7bc9485da7b82444b9bd4d0a',network_allocated='True',owner_project_name='tempest-TestStampPattern-734847133',owner_user_name='tempest-TestStampPattern-734847133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:37:24Z,user_data=None,user_id='c4f5d7ab7bc9485da7b82444b9bd4d0a',uuid=00222c42-f9a0-4a9a-afcd-30aa11b3a8f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "address": "fa:16:3e:d1:21:94", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60f73f2-f8", "ovs_interfaceid": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converting VIF {"id": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "address": "fa:16:3e:d1:21:94", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60f73f2-f8", "ovs_interfaceid": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:21:94,bridge_name='br-int',has_traffic_filtering=True,id=e60f73f2-f87f-4b47-acbd-78ec506ba37e,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60f73f2-f8') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.objects.instance [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'pci_devices' on Instance uuid 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:37:26 user nova-compute[70709]:   <uuid>00222c42-f9a0-4a9a-afcd-30aa11b3a8f6</uuid>
Jul 28 00:37:26 user nova-compute[70709]:   <name>instance-0000002b</name>
Jul 28 00:37:26 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:37:26 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:37:26 user nova-compute[70709]:   <metadata>
Jul 28 00:37:26 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:37:26 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:37:26 user nova-compute[70709]:       <nova:name>tempest-TestStampPattern-server-355782394</nova:name>
Jul 28 00:37:26 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:37:26</nova:creationTime>
Jul 28 00:37:26 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:37:26 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:37:26 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:37:26 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:37:26 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:37:26 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:37:26 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:37:26 user nova-compute[70709]:       <nova:owner>
Jul 28 00:37:26 user nova-compute[70709]:         <nova:user uuid="c4f5d7ab7bc9485da7b82444b9bd4d0a">tempest-TestStampPattern-734847133-project-member</nova:user>
Jul 28 00:37:26 user nova-compute[70709]:         <nova:project uuid="cda75c307259403282f8d98700806f24">tempest-TestStampPattern-734847133</nova:project>
Jul 28 00:37:26 user nova-compute[70709]:       </nova:owner>
Jul 28 00:37:26 user nova-compute[70709]:       <nova:root type="image" uuid="6cbe13b4-6491-4101-bda9-f8573bb243db"/>
Jul 28 00:37:26 user nova-compute[70709]:       <nova:ports>
Jul 28 00:37:26 user nova-compute[70709]:         <nova:port uuid="e60f73f2-f87f-4b47-acbd-78ec506ba37e">
Jul 28 00:37:26 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 28 00:37:26 user nova-compute[70709]:         </nova:port>
Jul 28 00:37:26 user nova-compute[70709]:       </nova:ports>
Jul 28 00:37:26 user nova-compute[70709]:     </nova:instance>
Jul 28 00:37:26 user nova-compute[70709]:   </metadata>
Jul 28 00:37:26 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:37:26 user nova-compute[70709]:     <system>
Jul 28 00:37:26 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:37:26 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:37:26 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:37:26 user nova-compute[70709]:       <entry name="serial">00222c42-f9a0-4a9a-afcd-30aa11b3a8f6</entry>
Jul 28 00:37:26 user nova-compute[70709]:       <entry name="uuid">00222c42-f9a0-4a9a-afcd-30aa11b3a8f6</entry>
Jul 28 00:37:26 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:37:26 user nova-compute[70709]:     </system>
Jul 28 00:37:26 user nova-compute[70709]:   </sysinfo>
Jul 28 00:37:26 user nova-compute[70709]:   <os>
Jul 28 00:37:26 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:37:26 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:37:26 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:37:26 user nova-compute[70709]:   </os>
Jul 28 00:37:26 user nova-compute[70709]:   <features>
Jul 28 00:37:26 user nova-compute[70709]:     <acpi/>
Jul 28 00:37:26 user nova-compute[70709]:     <apic/>
Jul 28 00:37:26 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:37:26 user nova-compute[70709]:   </features>
Jul 28 00:37:26 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:37:26 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:37:26 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:37:26 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:37:26 user nova-compute[70709]:   </clock>
Jul 28 00:37:26 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:37:26 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:37:26 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:37:26 user nova-compute[70709]:   </cpu>
Jul 28 00:37:26 user nova-compute[70709]:   <devices>
Jul 28 00:37:26 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:37:26 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:37:26 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk"/>
Jul 28 00:37:26 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:37:26 user nova-compute[70709]:     </disk>
Jul 28 00:37:26 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:37:26 user nova-compute[70709]:       <mac address="fa:16:3e:d1:21:94"/>
Jul 28 00:37:26 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:37:26 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:37:26 user nova-compute[70709]:       <target dev="tape60f73f2-f8"/>
Jul 28 00:37:26 user nova-compute[70709]:     </interface>
Jul 28 00:37:26 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:37:26 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/console.log" append="off"/>
Jul 28 00:37:26 user nova-compute[70709]:     </serial>
Jul 28 00:37:26 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:37:26 user nova-compute[70709]:     <video>
Jul 28 00:37:26 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:37:26 user nova-compute[70709]:     </video>
Jul 28 00:37:26 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:37:26 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:37:26 user nova-compute[70709]:     </rng>
Jul 28 00:37:26 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:37:26 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:37:26 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:37:26 user nova-compute[70709]:     </memballoon>
Jul 28 00:37:26 user nova-compute[70709]:   </devices>
Jul 28 00:37:26 user nova-compute[70709]: </domain>
Jul 28 00:37:26 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-355782394',display_name='tempest-TestStampPattern-server-355782394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-355782394',id=43,image_ref='6cbe13b4-6491-4101-bda9-f8573bb243db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbIsegpiueygcqxDMoqSRPiFzCAnNCeyeO9o7pyraW7IRIG5BvGlYKQLMkQxKgoyxaQdPTaJ/Hf8m0otg97bnUyVJ7NJ5OuhJ+tpoBcvNHMqX4UEk5LyzatE/ojR/Gr9A==',key_name='tempest-TestStampPattern-1821279517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cda75c307259403282f8d98700806f24',ramdisk_id='',reservation_id='r-ci6x3fcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0f2efeca-74ee-4d4b-a591-8cd8298d7ceb',image_min_disk='1',image_min_ram='0',image_owner_id='cda75c307259403282f8d98700806f24',image_owner_project_name='tempest-TestStampPattern-734847133',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-734847133-project-member',image_user_id='c4f5d7ab7bc9485da7b82444b9bd4d0a',network_allocated='True',owner_project_name='tempest-TestStampPattern-734847133',owner_user_name='tempest-TestStampPattern-734847133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:37:24Z,user_data=None,user_id='c4f5d7ab7bc9485da7b82444b9bd4d0a',uuid=00222c42-f9a0-4a9a-afcd-30aa11b3a8f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "address": "fa:16:3e:d1:21:94", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60f73f2-f8", "ovs_interfaceid": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converting VIF {"id": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "address": "fa:16:3e:d1:21:94", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60f73f2-f8", "ovs_interfaceid": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:21:94,bridge_name='br-int',has_traffic_filtering=True,id=e60f73f2-f87f-4b47-acbd-78ec506ba37e,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60f73f2-f8') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG os_vif [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:21:94,bridge_name='br-int',has_traffic_filtering=True,id=e60f73f2-f87f-4b47-acbd-78ec506ba37e,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60f73f2-f8') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape60f73f2-f8, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape60f73f2-f8, col_values=(('external_ids', {'iface-id': 'e60f73f2-f87f-4b47-acbd-78ec506ba37e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:21:94', 'vm-uuid': '00222c42-f9a0-4a9a-afcd-30aa11b3a8f6'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:27 user nova-compute[70709]: INFO os_vif [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:21:94,bridge_name='br-int',has_traffic_filtering=True,id=e60f73f2-f87f-4b47-acbd-78ec506ba37e,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60f73f2-f8')
Jul 28 00:37:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] No VIF found with MAC fa:16:3e:d1:21:94, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:28 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:37:28 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8240MB free_disk=25.134578704833984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance aeb18468-b813-42ff-9f27-9fc3bab1aaf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 2b0ebf99-78aa-4492-adee-f75b2330fef9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.manager [req-720a097e-2b92-4a69-bc13-962818be8517 req-fcd58c27-31f8-4fd5-becc-f52163d5fab2 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received event network-vif-plugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-720a097e-2b92-4a69-bc13-962818be8517 req-fcd58c27-31f8-4fd5-becc-f52163d5fab2 service nova] Acquiring lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-720a097e-2b92-4a69-bc13-962818be8517 req-fcd58c27-31f8-4fd5-becc-f52163d5fab2 service nova] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-720a097e-2b92-4a69-bc13-962818be8517 req-fcd58c27-31f8-4fd5-becc-f52163d5fab2 service nova] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.manager [req-720a097e-2b92-4a69-bc13-962818be8517 req-fcd58c27-31f8-4fd5-becc-f52163d5fab2 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] No waiting events found dispatching network-vif-plugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:37:28 user nova-compute[70709]: WARNING nova.compute.manager [req-720a097e-2b92-4a69-bc13-962818be8517 req-fcd58c27-31f8-4fd5-becc-f52163d5fab2 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received unexpected event network-vif-plugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e for instance with vm_state building and task_state spawning.
Jul 28 00:37:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:37:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:37:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:37:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:37:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504650.539169, 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:37:30 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] VM Resumed (Lifecycle Event)
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:37:30 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Instance spawned successfully.
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:37:30 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504650.5420415, 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:37:30 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] VM Started (Lifecycle Event)
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:37:30 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:37:30 user nova-compute[70709]: INFO nova.compute.manager [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Took 6.89 seconds to spawn the instance on the hypervisor.
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-3bb296da-3ad6-4307-943b-569b2287fb98 req-309f4132-5569-4659-aa7a-d7926e8c0e97 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received event network-vif-plugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3bb296da-3ad6-4307-943b-569b2287fb98 req-309f4132-5569-4659-aa7a-d7926e8c0e97 service nova] Acquiring lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3bb296da-3ad6-4307-943b-569b2287fb98 req-309f4132-5569-4659-aa7a-d7926e8c0e97 service nova] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3bb296da-3ad6-4307-943b-569b2287fb98 req-309f4132-5569-4659-aa7a-d7926e8c0e97 service nova] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG nova.compute.manager [req-3bb296da-3ad6-4307-943b-569b2287fb98 req-309f4132-5569-4659-aa7a-d7926e8c0e97 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] No waiting events found dispatching network-vif-plugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:37:30 user nova-compute[70709]: WARNING nova.compute.manager [req-3bb296da-3ad6-4307-943b-569b2287fb98 req-309f4132-5569-4659-aa7a-d7926e8c0e97 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received unexpected event network-vif-plugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e for instance with vm_state building and task_state spawning.
Jul 28 00:37:30 user nova-compute[70709]: INFO nova.compute.manager [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Took 7.64 seconds to build instance.
Jul 28 00:37:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2ca84765-f49f-47d9-b8bd-02de4f62e470 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.740s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:37:30 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:37:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:35 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:37:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:38 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:37:41 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:37:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:37:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:37:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:37:41 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:37:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:42 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Updating instance_info_cache with network_info: [{"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:37:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:37:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:37:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:37:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:37:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:01 user nova-compute[70709]: INFO nova.compute.manager [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Terminating instance
Jul 28 00:38:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:38:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-34b6a221-0e25-4736-a4e4-5d5ca0a7a749 req-281e7130-589f-4433-884e-2e4dce11bd03 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Received event network-vif-unplugged-83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-34b6a221-0e25-4736-a4e4-5d5ca0a7a749 req-281e7130-589f-4433-884e-2e4dce11bd03 service nova] Acquiring lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-34b6a221-0e25-4736-a4e4-5d5ca0a7a749 req-281e7130-589f-4433-884e-2e4dce11bd03 service nova] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-34b6a221-0e25-4736-a4e4-5d5ca0a7a749 req-281e7130-589f-4433-884e-2e4dce11bd03 service nova] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-34b6a221-0e25-4736-a4e4-5d5ca0a7a749 req-281e7130-589f-4433-884e-2e4dce11bd03 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] No waiting events found dispatching network-vif-unplugged-83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-34b6a221-0e25-4736-a4e4-5d5ca0a7a749 req-281e7130-589f-4433-884e-2e4dce11bd03 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Received event network-vif-unplugged-83039e8b-4639-43c6-a08d-48aeed4ee020 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Instance destroyed successfully.
Jul 28 00:38:02 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'resources' on Instance uuid aeb18468-b813-42ff-9f27-9fc3bab1aaf2 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1132786539',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1132786539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1132786539',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdl4Pp34RLDG/jg5LNDI7/Jpa5ECOu+z8qiltCBcAvgapoF46H2W6vdbz5cSO7Og9HM7ERRIAIEiHww8Bi/TLvvywF/0uucycIEW3qcCvZ7yfABTIO63OO7JOnVV/yZlQ==',key_name='tempest-keypair-1530777911',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:33:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-wu610k7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:33:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d994eb215f204b029d183b73539e3d4d',uuid=aeb18468-b813-42ff-9f27-9fc3bab1aaf2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "83039e8b-4639-43c6-a08d-48aeed4ee020", "address": "fa:16:3e:ad:6a:f1", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83039e8b-46", "ovs_interfaceid": "83039e8b-4639-43c6-a08d-48aeed4ee020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=83039e8b-4639-43c6-a08d-48aeed4ee020,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83039e8b-46') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_vif [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=83039e8b-4639-43c6-a08d-48aeed4ee020,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83039e8b-46') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83039e8b-46, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:38:02 user nova-compute[70709]: INFO os_vif [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=83039e8b-4639-43c6-a08d-48aeed4ee020,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83039e8b-46')
Jul 28 00:38:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlaKFbWw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:38:02 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b96494-fe18-45a2-85c9-43999d5932d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:38:02 user nova-compute[70709]: No targets found.
Jul 28 00:38:02 user nova-compute[70709]: iSNS:
Jul 28 00:38:02 user nova-compute[70709]: No targets found.
Jul 28 00:38:02 user nova-compute[70709]: STATIC:
Jul 28 00:38:02 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6
Jul 28 00:38:02 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:38:02 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:38:02 user nova-compute[70709]: FIRMWARE:
Jul 28 00:38:02 user nova-compute[70709]: No targets found.
Jul 28 00:38:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:38:02 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:38:02 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0a9296-258a-4fa6-9e44-1f25ca148736]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aef6c95-6bb6-4663-9c6c-4b7249b65725]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:38:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 (non-flash)
Jul 28 00:38:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90276ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6'): ({'sdb'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Removing single pathed devices sdb {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1517d242-f216-4dd2-9872-1e49ea7b8d47]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2d5b58-70c5-476a-8882-09ccc75d4d44]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flushing IO for device /dev/sdb {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4364170d-85ab-40c5-b2c0-ffa6c180f8b8]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b58605d-8bb3-454d-8579-65f3b5f7640c]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73bb3ae-e58e-405a-99d5-e14c6f322270]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73c3147-c6d9-4e9f-ad9f-64ab96b49634]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6, portal: 172.16.0.220,3260]
Jul 28 00:38:02 user nova-compute[70709]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6, portal: 172.16.0.220,3260] successful.
Jul 28 00:38:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021bcf23-3b73-429e-a62e-a4eed2b753b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a829c2ca-d6b1-47b5-877f-79424f10bab8]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== disconnect_volume: return (306ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:38:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Deleting instance files /opt/stack/data/nova/instances/aeb18468-b813-42ff-9f27-9fc3bab1aaf2_del
Jul 28 00:38:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Deletion of /opt/stack/data/nova/instances/aeb18468-b813-42ff-9f27-9fc3bab1aaf2_del complete
Jul 28 00:38:02 user nova-compute[70709]: INFO nova.compute.manager [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 28 00:38:02 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:38:02 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:38:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:03 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:38:03 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Took 0.91 seconds to deallocate network for instance.
Jul 28 00:38:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-e33f47c1-f63e-4776-98e7-7211a2bd688d req-2bc52203-de21-46ee-a063-0038d2964cf0 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Received event network-vif-deleted-83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:38:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-26806731-613c-4894-8f85-ae4a5f837fb6 req-df57f813-eef2-4b0f-8da0-55c68d8969d9 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Received event network-vif-plugged-83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:38:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-26806731-613c-4894-8f85-ae4a5f837fb6 req-df57f813-eef2-4b0f-8da0-55c68d8969d9 service nova] Acquiring lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-26806731-613c-4894-8f85-ae4a5f837fb6 req-df57f813-eef2-4b0f-8da0-55c68d8969d9 service nova] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-26806731-613c-4894-8f85-ae4a5f837fb6 req-df57f813-eef2-4b0f-8da0-55c68d8969d9 service nova] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-26806731-613c-4894-8f85-ae4a5f837fb6 req-df57f813-eef2-4b0f-8da0-55c68d8969d9 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] No waiting events found dispatching network-vif-plugged-83039e8b-4639-43c6-a08d-48aeed4ee020 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:38:04 user nova-compute[70709]: WARNING nova.compute.manager [req-26806731-613c-4894-8f85-ae4a5f837fb6 req-df57f813-eef2-4b0f-8da0-55c68d8969d9 service nova] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Received unexpected event network-vif-plugged-83039e8b-4639-43c6-a08d-48aeed4ee020 for instance with vm_state active and task_state deleting.
Jul 28 00:38:04 user nova-compute[70709]: INFO nova.compute.manager [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Took 0.69 seconds to detach 1 volumes for instance.
Jul 28 00:38:04 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Deleting volume: 021bcf23-3b73-429e-a62e-a4eed2b753b6 {{(pid=70709) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 28 00:38:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:04 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:38:04 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:38:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:04 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Deleted allocations for instance aeb18468-b813-42ff-9f27-9fc3bab1aaf2
Jul 28 00:38:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b2e5e5de-f1b4-494f-bc9d-f23db01664ba tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "aeb18468-b813-42ff-9f27-9fc3bab1aaf2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.244s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:07 user nova-compute[70709]: INFO nova.compute.manager [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Terminating instance
Jul 28 00:38:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:38:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-b1188c29-9aff-4d2c-8f42-d7438538582c req-69b12f6e-6293-4f50-a78e-3c957f893d2d service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-vif-unplugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b1188c29-9aff-4d2c-8f42-d7438538582c req-69b12f6e-6293-4f50-a78e-3c957f893d2d service nova] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b1188c29-9aff-4d2c-8f42-d7438538582c req-69b12f6e-6293-4f50-a78e-3c957f893d2d service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b1188c29-9aff-4d2c-8f42-d7438538582c req-69b12f6e-6293-4f50-a78e-3c957f893d2d service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-b1188c29-9aff-4d2c-8f42-d7438538582c req-69b12f6e-6293-4f50-a78e-3c957f893d2d service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] No waiting events found dispatching network-vif-unplugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG nova.compute.manager [req-b1188c29-9aff-4d2c-8f42-d7438538582c req-69b12f6e-6293-4f50-a78e-3c957f893d2d service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-vif-unplugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:08 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Instance destroyed successfully.
Jul 28 00:38:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lazy-loading 'resources' on Instance uuid 2b0ebf99-78aa-4492-adee-f75b2330fef9 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-272337933',display_name='tempest-TestServerVolumeAttachmentScenario-server-272337933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-272337933',id=38,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0HsORX+nsdjHhbxq9N0GTLbcH2VjBBb/ywTqtebgF/sVXVgOv4JC0n7DLk3gnLNJRZ/ARffSmple06A2NYSV9MMTbglCl3bs4mPPjMxf1CFAUX3J7+/tVVaAK/3IUs9g==',key_name='tempest-keypair-1185571877',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21413b84362a4244a830986bc663b72f',ramdisk_id='',reservation_id='r-wa5r38j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-759439176',owner_user_name='tempest-TestServerVolumeAttachmentScenario-759439176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:34:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182c2d69fdb64ae0bddaca7ccec14d5e',uuid=2b0ebf99-78aa-4492-adee-f75b2330fef9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Converting VIF {"id": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "address": "fa:16:3e:3e:40:a2", "network": {"id": "300fb8c0-10f0-4dd1-90ba-348e0b1b1964", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110231660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21413b84362a4244a830986bc663b72f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a67858a-ee", "ovs_interfaceid": "9a67858a-eecb-4d79-9cc7-c07c11f4eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=9a67858a-eecb-4d79-9cc7-c07c11f4eebf,network=Network(300fb8c0-10f0-4dd1-90ba-348e0b1b1964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a67858a-ee') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG os_vif [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=9a67858a-eecb-4d79-9cc7-c07c11f4eebf,network=Network(300fb8c0-10f0-4dd1-90ba-348e0b1b1964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a67858a-ee') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a67858a-ee, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:38:08 user nova-compute[70709]: INFO os_vif [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=9a67858a-eecb-4d79-9cc7-c07c11f4eebf,network=Network(300fb8c0-10f0-4dd1-90ba-348e0b1b1964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a67858a-ee')
Jul 28 00:38:08 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Deleting instance files /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9_del
Jul 28 00:38:08 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Deletion of /opt/stack/data/nova/instances/2b0ebf99-78aa-4492-adee-f75b2330fef9_del complete
Jul 28 00:38:08 user nova-compute[70709]: INFO nova.compute.manager [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 28 00:38:08 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:09 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:38:09 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Took 1.14 seconds to deallocate network for instance.
Jul 28 00:38:09 user nova-compute[70709]: DEBUG nova.compute.manager [req-d5e0340c-2e6e-42b0-9766-0df592ab392a req-4ab8db1a-51e3-42c3-bd8e-1ab0278699c7 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-vif-deleted-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:38:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:09 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:38:09 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:38:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:09 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Deleted allocations for instance 2b0ebf99-78aa-4492-adee-f75b2330fef9
Jul 28 00:38:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ce39bca2-93f8-4b5e-acbc-655284408d59 tempest-TestServerVolumeAttachmentScenario-759439176 tempest-TestServerVolumeAttachmentScenario-759439176-project-member] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.501s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] No waiting events found dispatching network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:38:10 user nova-compute[70709]: WARNING nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received unexpected event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf for instance with vm_state deleted and task_state None.
Jul 28 00:38:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] No waiting events found dispatching network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:38:10 user nova-compute[70709]: WARNING nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received unexpected event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf for instance with vm_state deleted and task_state None.
Jul 28 00:38:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] No waiting events found dispatching network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:38:10 user nova-compute[70709]: WARNING nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received unexpected event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf for instance with vm_state deleted and task_state None.
Jul 28 00:38:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-vif-unplugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] No waiting events found dispatching network-vif-unplugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:38:10 user nova-compute[70709]: WARNING nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received unexpected event network-vif-unplugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf for instance with vm_state deleted and task_state None.
Jul 28 00:38:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Acquiring lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] Lock "2b0ebf99-78aa-4492-adee-f75b2330fef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:10 user nova-compute[70709]: DEBUG nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] No waiting events found dispatching network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:38:10 user nova-compute[70709]: WARNING nova.compute.manager [req-d2e20620-df0d-4e30-bd8f-0ca3e1e39988 req-c4d0008d-1cd4-4628-bbc1-a2666f9bce89 service nova] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Received unexpected event network-vif-plugged-9a67858a-eecb-4d79-9cc7-c07c11f4eebf for instance with vm_state deleted and task_state None.
Jul 28 00:38:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:17 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504682.4977264, aeb18468-b813-42ff-9f27-9fc3bab1aaf2 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:38:17 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] VM Stopped (Lifecycle Event)
Jul 28 00:38:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-851f1de7-b9e4-40ec-a5e4-0161e7515dae None None] [instance: aeb18468-b813-42ff-9f27-9fc3bab1aaf2] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:38:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:38:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:38:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:38:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:38:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:23 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504688.3161514, 2b0ebf99-78aa-4492-adee-f75b2330fef9 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:38:23 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] VM Stopped (Lifecycle Event)
Jul 28 00:38:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-7da9ad62-3fdf-469d-aedd-ff1326d1034c None None] [instance: 2b0ebf99-78aa-4492-adee-f75b2330fef9] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:38:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:38:25 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:38:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:25 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:38:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:38:27 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:38:27 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:38:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8339MB free_disk=25.15923309326172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:38:27 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:38:28 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:38:28 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:38:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:38:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:38:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:38:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:38:30 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:38:30 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:38:31 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:38:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:38:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:38:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:38:38 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:38:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:38:41 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:38:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:38:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:38:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:38:41 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:38:42 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updating instance_info_cache with network_info: [{"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:38:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:38:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:38:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:38:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:38:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "0455687d-6492-40dd-b636-c6a7f8760184" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:39:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:02 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:39:02 user nova-compute[70709]: INFO nova.compute.claims [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Claim successful on node user
Jul 28 00:39:02 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:39:02 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:39:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:39:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:39:02 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:39:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:39:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:39:02 user nova-compute[70709]: INFO nova.virt.block_device [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Booting with volume 72444c3c-4a7e-43bf-b6f7-961f5301eb1d at /dev/vda
Jul 28 00:39:02 user nova-compute[70709]: DEBUG nova.policy [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd994eb215f204b029d183b73539e3d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d88e18679b4bc49c010b68ca813dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG os_brick.utils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14e52af-9ab9-4e74-bead-9e81b80e95eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ca8765-a79f-463b-8b65-2dd6ed5cb75e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e82122f-403d-4972-9160-287f91188005]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c974c711-17b3-49f5-a468-96d308efdbf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:39:03 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:39:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6f2fd8-0226-44ec-b12f-77299292873c]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG os_brick.utils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Updating existing volume attachment record: b654da45-9556-4a22-9494-da6a5189d95b {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:03 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Successfully created port: 0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:39:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:04 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Successfully updated port: 0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:39:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "refresh_cache-0455687d-6492-40dd-b636-c6a7f8760184" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:39:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquired lock "refresh_cache-0455687d-6492-40dd-b636-c6a7f8760184" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:39:04 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:39:04 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:39:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-ef1a2fde-c40f-4933-9cd3-d687d09bc03e req-705773e8-2ab0-4598-a4da-64323b2f36e9 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-changed-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:39:04 user nova-compute[70709]: DEBUG nova.compute.manager [req-ef1a2fde-c40f-4933-9cd3-d687d09bc03e req-705773e8-2ab0-4598-a4da-64323b2f36e9 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Refreshing instance network info cache due to event network-changed-0b260b36-5ee9-45b3-aba6-1c123dd96f14. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:39:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ef1a2fde-c40f-4933-9cd3-d687d09bc03e req-705773e8-2ab0-4598-a4da-64323b2f36e9 service nova] Acquiring lock "refresh_cache-0455687d-6492-40dd-b636-c6a7f8760184" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:39:04 user nova-compute[70709]: DEBUG nova.network.neutron [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Updating instance_info_cache with network_info: [{"id": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "address": "fa:16:3e:19:95:8a", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b260b36-5e", "ovs_interfaceid": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:39:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Releasing lock "refresh_cache-0455687d-6492-40dd-b636-c6a7f8760184" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:39:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Instance network_info: |[{"id": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "address": "fa:16:3e:19:95:8a", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b260b36-5e", "ovs_interfaceid": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:39:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ef1a2fde-c40f-4933-9cd3-d687d09bc03e req-705773e8-2ab0-4598-a4da-64323b2f36e9 service nova] Acquired lock "refresh_cache-0455687d-6492-40dd-b636-c6a7f8760184" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:39:05 user nova-compute[70709]: DEBUG nova.network.neutron [req-ef1a2fde-c40f-4933-9cd3-d687d09bc03e req-705773e8-2ab0-4598-a4da-64323b2f36e9 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Refreshing network info cache for port 0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:39:05 user nova-compute[70709]: DEBUG nova.network.neutron [req-ef1a2fde-c40f-4933-9cd3-d687d09bc03e req-705773e8-2ab0-4598-a4da-64323b2f36e9 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Updated VIF entry in instance network info cache for port 0b260b36-5ee9-45b3-aba6-1c123dd96f14. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:39:05 user nova-compute[70709]: DEBUG nova.network.neutron [req-ef1a2fde-c40f-4933-9cd3-d687d09bc03e req-705773e8-2ab0-4598-a4da-64323b2f36e9 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Updating instance_info_cache with network_info: [{"id": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "address": "fa:16:3e:19:95:8a", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b260b36-5e", "ovs_interfaceid": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:39:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ef1a2fde-c40f-4933-9cd3-d687d09bc03e req-705773e8-2ab0-4598-a4da-64323b2f36e9 service nova] Releasing lock "refresh_cache-0455687d-6492-40dd-b636-c6a7f8760184" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:39:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:39:10 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Creating image(s)
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Ensure instance console log exists: /opt/stack/data/nova/instances/0455687d-6492-40dd-b636-c6a7f8760184/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Start _get_guest_xml network_info=[{"id": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "address": "fa:16:3e:19:95:8a", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b260b36-5e", "ovs_interfaceid": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b654da45-9556-4a22-9494-da6a5189d95b', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzKoQUxu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0455687d-6492-40dd-b636-c6a7f8760184', 'attached_at': '', 'detached_at': '', 'volume_id': '72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 'serial': '72444c3c-4a7e-43bf-b6f7-961f5301eb1d'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:39:10 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:39:10 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzKoQUxu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:39:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:39:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:39:10 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58f7af8-da4d-4ac6-943e-040bb90c292b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:39:10 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[267226f2-f354-452d-bbee-0d9e88defa4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d] added
Jul 28 00:39:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6574bf95-3f1d-45b2-a1c1-85635afdd446]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f6c2d-6656-454d-9933-3e495287ad18]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzKoQUxu {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzKoQUxu" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbec30b-20a8-4a40-bbcf-92129735b9a2]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WzKoQUxu'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e500a958-edb8-4228-acbf-16d2a138f6ba]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f80910b-1d91-4461-9e3d-cf4035c38b7b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 28 00:39:10 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 28 00:39:10 user nova-compute[70709]:  {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:39:10 user nova-compute[70709]: WARNING os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 28 00:39:10 user nova-compute[70709]: 
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0e78b2-91d0-4e12-afab-affe17a86aca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260]
Jul 28 00:39:10 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260] successful.
Jul 28 00:39:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8238d7-26f0-41bf-92ab-fce6b3d95014]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e42d5af-f974-4e68-9a83-3a91f7ddac02]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:39:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:39:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ef2a86-4937-4cb4-ab56-6b0d3781bdf9]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:39:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzKoQUxu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23134316530313432', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134316530313432', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1291075343',display_name='tempest-TestVolumeBootPattern-server-1291075343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1291075343',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJASKlujGBh7q4FjBKCwUDBKdkAi9ZlmeDUwzkD1Smbvo/bJjZcXJHiVRyG3yLb9/84JrQ3NFZZ8DFC79UmemaYV3pBVbiAP8M5fiEEtqWcYd/Pk5XyfaCP8BM8JvkX0XQ==',key_name='tempest-TestVolumeBootPattern-248605266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-mnoa7enj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:39:03Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=0455687d-6492-40dd-b636-c6a7f8760184,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "address": "fa:16:3e:19:95:8a", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b260b36-5e", "ovs_interfaceid": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "address": "fa:16:3e:19:95:8a", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b260b36-5e", "ovs_interfaceid": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0b260b36-5ee9-45b3-aba6-1c123dd96f14,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b260b36-5e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG nova.objects.instance [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'pci_devices' on Instance uuid 0455687d-6492-40dd-b636-c6a7f8760184 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:39:11 user nova-compute[70709]:   <uuid>0455687d-6492-40dd-b636-c6a7f8760184</uuid>
Jul 28 00:39:11 user nova-compute[70709]:   <name>instance-0000002c</name>
Jul 28 00:39:11 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:39:11 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:39:11 user nova-compute[70709]:   <metadata>
Jul 28 00:39:11 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:39:11 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:39:11 user nova-compute[70709]:       <nova:name>tempest-TestVolumeBootPattern-server-1291075343</nova:name>
Jul 28 00:39:11 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:39:10</nova:creationTime>
Jul 28 00:39:11 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:39:11 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:39:11 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:39:11 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:39:11 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:39:11 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:39:11 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:39:11 user nova-compute[70709]:       <nova:owner>
Jul 28 00:39:11 user nova-compute[70709]:         <nova:user uuid="d994eb215f204b029d183b73539e3d4d">tempest-TestVolumeBootPattern-2090046407-project-member</nova:user>
Jul 28 00:39:11 user nova-compute[70709]:         <nova:project uuid="47d88e18679b4bc49c010b68ca813dab">tempest-TestVolumeBootPattern-2090046407</nova:project>
Jul 28 00:39:11 user nova-compute[70709]:       </nova:owner>
Jul 28 00:39:11 user nova-compute[70709]:       <nova:ports>
Jul 28 00:39:11 user nova-compute[70709]:         <nova:port uuid="0b260b36-5ee9-45b3-aba6-1c123dd96f14">
Jul 28 00:39:11 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 28 00:39:11 user nova-compute[70709]:         </nova:port>
Jul 28 00:39:11 user nova-compute[70709]:       </nova:ports>
Jul 28 00:39:11 user nova-compute[70709]:     </nova:instance>
Jul 28 00:39:11 user nova-compute[70709]:   </metadata>
Jul 28 00:39:11 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:39:11 user nova-compute[70709]:     <system>
Jul 28 00:39:11 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:39:11 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:39:11 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:39:11 user nova-compute[70709]:       <entry name="serial">0455687d-6492-40dd-b636-c6a7f8760184</entry>
Jul 28 00:39:11 user nova-compute[70709]:       <entry name="uuid">0455687d-6492-40dd-b636-c6a7f8760184</entry>
Jul 28 00:39:11 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:39:11 user nova-compute[70709]:     </system>
Jul 28 00:39:11 user nova-compute[70709]:   </sysinfo>
Jul 28 00:39:11 user nova-compute[70709]:   <os>
Jul 28 00:39:11 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:39:11 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:39:11 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:39:11 user nova-compute[70709]:   </os>
Jul 28 00:39:11 user nova-compute[70709]:   <features>
Jul 28 00:39:11 user nova-compute[70709]:     <acpi/>
Jul 28 00:39:11 user nova-compute[70709]:     <apic/>
Jul 28 00:39:11 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:39:11 user nova-compute[70709]:   </features>
Jul 28 00:39:11 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:39:11 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:39:11 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:39:11 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:39:11 user nova-compute[70709]:   </clock>
Jul 28 00:39:11 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:39:11 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:39:11 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:39:11 user nova-compute[70709]:   </cpu>
Jul 28 00:39:11 user nova-compute[70709]:   <devices>
Jul 28 00:39:11 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:39:11 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:39:11 user nova-compute[70709]:       <source dev="/dev/sdb"/>
Jul 28 00:39:11 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:39:11 user nova-compute[70709]:       <serial>72444c3c-4a7e-43bf-b6f7-961f5301eb1d</serial>
Jul 28 00:39:11 user nova-compute[70709]:     </disk>
Jul 28 00:39:11 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:39:11 user nova-compute[70709]:       <mac address="fa:16:3e:19:95:8a"/>
Jul 28 00:39:11 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:39:11 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:39:11 user nova-compute[70709]:       <target dev="tap0b260b36-5e"/>
Jul 28 00:39:11 user nova-compute[70709]:     </interface>
Jul 28 00:39:11 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:39:11 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/0455687d-6492-40dd-b636-c6a7f8760184/console.log" append="off"/>
Jul 28 00:39:11 user nova-compute[70709]:     </serial>
Jul 28 00:39:11 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:39:11 user nova-compute[70709]:     <video>
Jul 28 00:39:11 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:39:11 user nova-compute[70709]:     </video>
Jul 28 00:39:11 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:39:11 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:39:11 user nova-compute[70709]:     </rng>
Jul 28 00:39:11 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:39:11 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:39:11 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:39:11 user nova-compute[70709]:     </memballoon>
Jul 28 00:39:11 user nova-compute[70709]:   </devices>
Jul 28 00:39:11 user nova-compute[70709]: </domain>
Jul 28 00:39:11 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1291075343',display_name='tempest-TestVolumeBootPattern-server-1291075343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1291075343',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJASKlujGBh7q4FjBKCwUDBKdkAi9ZlmeDUwzkD1Smbvo/bJjZcXJHiVRyG3yLb9/84JrQ3NFZZ8DFC79UmemaYV3pBVbiAP8M5fiEEtqWcYd/Pk5XyfaCP8BM8JvkX0XQ==',key_name='tempest-TestVolumeBootPattern-248605266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-mnoa7enj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:39:03Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=0455687d-6492-40dd-b636-c6a7f8760184,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "address": "fa:16:3e:19:95:8a", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b260b36-5e", "ovs_interfaceid": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "address": "fa:16:3e:19:95:8a", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b260b36-5e", "ovs_interfaceid": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0b260b36-5ee9-45b3-aba6-1c123dd96f14,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b260b36-5e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG os_vif [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0b260b36-5ee9-45b3-aba6-1c123dd96f14,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b260b36-5e') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b260b36-5e, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b260b36-5e, col_values=(('external_ids', {'iface-id': '0b260b36-5ee9-45b3-aba6-1c123dd96f14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:95:8a', 'vm-uuid': '0455687d-6492-40dd-b636-c6a7f8760184'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:11 user nova-compute[70709]: INFO os_vif [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0b260b36-5ee9-45b3-aba6-1c123dd96f14,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b260b36-5e')
Jul 28 00:39:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:39:11 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No VIF found with MAC fa:16:3e:19:95:8a, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:39:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:13 user nova-compute[70709]: DEBUG nova.compute.manager [req-b77c751d-0efc-46a5-8832-b581f1a64987 req-5b31215d-3980-4078-8a89-ff6c0f865e3b service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:39:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b77c751d-0efc-46a5-8832-b581f1a64987 req-5b31215d-3980-4078-8a89-ff6c0f865e3b service nova] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b77c751d-0efc-46a5-8832-b581f1a64987 req-5b31215d-3980-4078-8a89-ff6c0f865e3b service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b77c751d-0efc-46a5-8832-b581f1a64987 req-5b31215d-3980-4078-8a89-ff6c0f865e3b service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:13 user nova-compute[70709]: DEBUG nova.compute.manager [req-b77c751d-0efc-46a5-8832-b581f1a64987 req-5b31215d-3980-4078-8a89-ff6c0f865e3b service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] No waiting events found dispatching network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:39:13 user nova-compute[70709]: WARNING nova.compute.manager [req-b77c751d-0efc-46a5-8832-b581f1a64987 req-5b31215d-3980-4078-8a89-ff6c0f865e3b service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received unexpected event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 for instance with vm_state building and task_state spawning.
Jul 28 00:39:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504755.0706527, 0455687d-6492-40dd-b636-c6a7f8760184 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:39:15 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] VM Resumed (Lifecycle Event)
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:39:15 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Instance spawned successfully.
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:15 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504755.0709248, 0455687d-6492-40dd-b636-c6a7f8760184 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:39:15 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] VM Started (Lifecycle Event)
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:39:15 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:39:15 user nova-compute[70709]: INFO nova.compute.manager [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Took 4.94 seconds to spawn the instance on the hypervisor.
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:39:15 user nova-compute[70709]: INFO nova.compute.manager [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Took 12.88 seconds to build instance.
Jul 28 00:39:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-2121343e-f3b0-4fad-b5fb-45ae2ffb6330 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "0455687d-6492-40dd-b636-c6a7f8760184" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.987s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-d6d0e8b9-e300-4941-8145-e8a5aab7aff0 req-43356c9d-b669-4971-bee3-c8332c9bd1b0 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received event network-changed-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-d6d0e8b9-e300-4941-8145-e8a5aab7aff0 req-43356c9d-b669-4971-bee3-c8332c9bd1b0 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Refreshing instance network info cache due to event network-changed-e60f73f2-f87f-4b47-acbd-78ec506ba37e. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6d0e8b9-e300-4941-8145-e8a5aab7aff0 req-43356c9d-b669-4971-bee3-c8332c9bd1b0 service nova] Acquiring lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6d0e8b9-e300-4941-8145-e8a5aab7aff0 req-43356c9d-b669-4971-bee3-c8332c9bd1b0 service nova] Acquired lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.network.neutron [req-d6d0e8b9-e300-4941-8145-e8a5aab7aff0 req-43356c9d-b669-4971-bee3-c8332c9bd1b0 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Refreshing network info cache for port e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-49209894-da40-4ba2-a3d3-a523cace22ab req-a3b4a707-a2df-44be-9e3d-e17399250601 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-49209894-da40-4ba2-a3d3-a523cace22ab req-a3b4a707-a2df-44be-9e3d-e17399250601 service nova] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-49209894-da40-4ba2-a3d3-a523cace22ab req-a3b4a707-a2df-44be-9e3d-e17399250601 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-49209894-da40-4ba2-a3d3-a523cace22ab req-a3b4a707-a2df-44be-9e3d-e17399250601 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.compute.manager [req-49209894-da40-4ba2-a3d3-a523cace22ab req-a3b4a707-a2df-44be-9e3d-e17399250601 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] No waiting events found dispatching network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:39:15 user nova-compute[70709]: WARNING nova.compute.manager [req-49209894-da40-4ba2-a3d3-a523cace22ab req-a3b4a707-a2df-44be-9e3d-e17399250601 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received unexpected event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 for instance with vm_state active and task_state None.
Jul 28 00:39:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'flavor' on Instance uuid 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:16 user nova-compute[70709]: INFO nova.compute.manager [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Attaching volume 12a447f3-8b43-46e1-a774-5283dc88a17c to /dev/vdb
Jul 28 00:39:16 user nova-compute[70709]: DEBUG os_brick.utils [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[be57e0bf-8f91-4d2b-9620-0f1cfe256c34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[39456540-a264-4b0a-809e-955b86551771]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd066b7c-5e3d-4f70-b7f6-c3e30d243af7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[473b7955-7ff6-41a0-9a95-775110b428ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:39:16 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a977f6fd-f65c-46c2-bbe1-b059b1fdc6fb]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG os_brick.utils [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Updating existing volume attachment record: ab7cca9d-e3fe-4a73-a5bc-b2edd801be66 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG nova.network.neutron [req-d6d0e8b9-e300-4941-8145-e8a5aab7aff0 req-43356c9d-b669-4971-bee3-c8332c9bd1b0 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Updated VIF entry in instance network info cache for port e60f73f2-f87f-4b47-acbd-78ec506ba37e. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG nova.network.neutron [req-d6d0e8b9-e300-4941-8145-e8a5aab7aff0 req-43356c9d-b669-4971-bee3-c8332c9bd1b0 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Updating instance_info_cache with network_info: [{"id": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "address": "fa:16:3e:d1:21:94", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60f73f2-f8", "ovs_interfaceid": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d6d0e8b9-e300-4941-8145-e8a5aab7aff0 req-43356c9d-b669-4971-bee3-c8332c9bd1b0 service nova] Releasing lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:39:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrRofaTF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:39:23 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:39:23 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:39:23 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[996228b4-5bf4-4afc-80a7-5d81b8a905ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:39:23 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f30b85a-3cc8-4283-b5d7-f42f7855e09d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c] added
Jul 28 00:39:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb83a1ce-f24c-43d1-8e75-a9a062a32b2f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91b38a8-f2f0-4289-9778-b27a2e4984b1]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrRofaTF {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrRofaTF" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[46707f07-7fbf-42b9-b5a6-a87288aa3f99]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lrRofaTF'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c2aa0b-560c-4905-827b-48b2b0b8f755]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7539f82b-0281-4926-86b0-7882edb39c74]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:39:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:39:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[846c4efe-2093-4412-9bae-c31675a3374f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c, portal: 172.16.0.220,3260]
Jul 28 00:39:23 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c, portal: 172.16.0.220,3260] successful.
Jul 28 00:39:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1578c8c1-82c2-47bf-9637-570aeb04a74a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2163dcf5-8dbc-403e-a641-b5589fa8741c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:39:23 user nova-compute[70709]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c (non-flash)
Jul 28 00:39:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:39:23 user nova-compute[70709]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c (non-flash)
Jul 28 00:39:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c70730-bc74-4fe7-a226-241a280721ba]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:39:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrRofaTF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:39:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:39:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23035633236393434', 'path': '/dev/sdc'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:39:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035633236393434', 'path': '/dev/sdc'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:39:24 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'flavor' on Instance uuid 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:39:24 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:39:24 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:39:24 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:39:24 user nova-compute[70709]:   <serial>12a447f3-8b43-46e1-a774-5283dc88a17c</serial>
Jul 28 00:39:24 user nova-compute[70709]: </disk>
Jul 28 00:39:24 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:39:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:39:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:39:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] No VIF found with MAC fa:16:3e:d1:21:94, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:39:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8edf0f07-374d-416b-9b74-7b75486cd7c2 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.460s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:25 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:39:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:26 user nova-compute[70709]: INFO nova.compute.manager [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Detaching volume 12a447f3-8b43-46e1-a774-5283dc88a17c
Jul 28 00:39:27 user nova-compute[70709]: INFO nova.virt.block_device [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Attempting to driver detach volume 12a447f3-8b43-46e1-a774-5283dc88a17c from mountpoint /dev/vdb
Jul 28 00:39:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Attempting to detach device vdb from instance 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:39:27 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:39:27 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:39:27 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:39:27 user nova-compute[70709]:   <serial>12a447f3-8b43-46e1-a774-5283dc88a17c</serial>
Jul 28 00:39:27 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:39:27 user nova-compute[70709]: </disk>
Jul 28 00:39:27 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:39:27 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Successfully detached device vdb from instance 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 from the persistent domain config.
Jul 28 00:39:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:39:27 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:39:27 user nova-compute[70709]:   <source dev="/dev/sdc"/>
Jul 28 00:39:27 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:39:27 user nova-compute[70709]:   <serial>12a447f3-8b43-46e1-a774-5283dc88a17c</serial>
Jul 28 00:39:27 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:39:27 user nova-compute[70709]: </disk>
Jul 28 00:39:27 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504767.4691517, 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:39:27 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Successfully detached device vdb from instance 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 from the live domain config.
Jul 28 00:39:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrRofaTF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:39:27 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd78cbe-b28c-4a4c-bd76-daa859546a2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:39:27 user nova-compute[70709]: No targets found.
Jul 28 00:39:27 user nova-compute[70709]: iSNS:
Jul 28 00:39:27 user nova-compute[70709]: No targets found.
Jul 28 00:39:27 user nova-compute[70709]: STATIC:
Jul 28 00:39:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c
Jul 28 00:39:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:39:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:39:27 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d
Jul 28 00:39:27 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:39:27 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:39:27 user nova-compute[70709]: FIRMWARE:
Jul 28 00:39:27 user nova-compute[70709]: No targets found.
Jul 28 00:39:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:39:27 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:39:27 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f025aa4-c789-4883-a2dc-82f1aa82ea0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e922c7a2-9054-4681-a35d-d4f6540a63f3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:39:27 user nova-compute[70709]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c (non-flash)
Jul 28 00:39:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:39:27 user nova-compute[70709]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c (non-flash)
Jul 28 00:39:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b8839b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c'): ({'sdc'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Removing single pathed devices sdc {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57eb3eb-b32b-4b81-a5b0-7f370be31b97]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22f3419-3344-4f29-adda-abec20bc23e9]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Flushing IO for device /dev/sdc {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed133faa-6681-4d1a-8ce5-0ed2d57cfe66]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b02e7ec-4081-44bd-971c-ffc916887e47]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb9af7e-6582-4c75-b833-0bdbb8307fe1]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fda1fb-251e-401e-96e1-33d2229c0b88]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c, portal: 172.16.0.220,3260]
Jul 28 00:39:27 user nova-compute[70709]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c, portal: 172.16.0.220,3260] successful.
Jul 28 00:39:27 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a447f3-8b43-46e1-a774-5283dc88a17c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83c31e4-8789-4ea0-8d04-c8af95f87e65]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] <== disconnect_volume: return (307ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:27 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG nova.objects.instance [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'flavor' on Instance uuid 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-92252ec8-fe1a-4e5a-b667-348bd735fd59 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.979s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:29 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:39:29 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:39:29 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8240MB free_disk=25.147354125976562GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:39:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:30 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:39:30 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:39:30 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:39:30 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:39:30 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 0455687d-6492-40dd-b636-c6a7f8760184 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:39:30 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:39:30 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:39:30 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:39:30 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:39:30 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:39:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:31 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:39:31 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:39:31 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:39:31 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:39:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:39:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:39:38 user nova-compute[70709]: INFO nova.compute.claims [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Claim successful on node user
Jul 28 00:39:38 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG nova.network.neutron [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:39:38 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:39:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:39:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:39:39 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Creating image(s)
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "/opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "/opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "/opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG nova.policy [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e898b8e480e4d40a8e40beec39f2b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e5b0ed17745a188b54c44f426eca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk 1073741824" returned: 0 in 0.057s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.184s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Cannot resize image /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG nova.objects.instance [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'migration_context' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Ensure instance console log exists: /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:39:39 user nova-compute[70709]: DEBUG nova.network.neutron [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Successfully created port: 0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:39:40 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.neutron [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Successfully updated port: 0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquired lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.neutron [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-f002acc9-ee56-47ab-b00e-59223be298b7 req-fd11743e-acbf-4bc1-bf9b-6cb39d9b1fbc service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Received event network-changed-0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.compute.manager [req-f002acc9-ee56-47ab-b00e-59223be298b7 req-fd11743e-acbf-4bc1-bf9b-6cb39d9b1fbc service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Refreshing instance network info cache due to event network-changed-0ee4a18f-b92b-4bff-930f-0815d6962257. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f002acc9-ee56-47ab-b00e-59223be298b7 req-fd11743e-acbf-4bc1-bf9b-6cb39d9b1fbc service nova] Acquiring lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.neutron [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.neutron [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updating instance_info_cache with network_info: [{"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Releasing lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Instance network_info: |[{"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f002acc9-ee56-47ab-b00e-59223be298b7 req-fd11743e-acbf-4bc1-bf9b-6cb39d9b1fbc service nova] Acquired lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-f002acc9-ee56-47ab-b00e-59223be298b7 req-fd11743e-acbf-4bc1-bf9b-6cb39d9b1fbc service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Refreshing network info cache for port 0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Start _get_guest_xml network_info=[{"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:39:41 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:39:41 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-112727453',display_name='tempest-SnapshotDataIntegrityTests-server-112727453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-112727453',id=45,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUDG6krpW8/YAljBawVWqsAhNlfZT3/ppckXM//SxebFynWqAYbE8xpGFLrxvAEdm2hcC31TWWTZqLO1yZRzQTyKnla3B3+M2xI4EJf9ejzlO1nEX7skLbhhZgxF3vDmg==',key_name='tempest-keypair-1021118189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='578e5b0ed17745a188b54c44f426eca9',ramdisk_id='',reservation_id='r-3p9k3bjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2056239659',owner_user_name='tempest-SnapshotDataIntegrityTests-2056239659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e898b8e480e4d40a8e40beec39f2b66',uuid=4658dea2-f6e3-47db-8e37-97d64c70fe4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Converting VIF {"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ee4a18f-b92b-4bff-930f-0815d6962257,network=Network(66d15025-063a-47d7-9a20-086bf8e56d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee4a18f-b9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.objects.instance [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'pci_devices' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:39:41 user nova-compute[70709]:   <uuid>4658dea2-f6e3-47db-8e37-97d64c70fe4c</uuid>
Jul 28 00:39:41 user nova-compute[70709]:   <name>instance-0000002d</name>
Jul 28 00:39:41 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:39:41 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:39:41 user nova-compute[70709]:   <metadata>
Jul 28 00:39:41 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:39:41 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:39:41 user nova-compute[70709]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-112727453</nova:name>
Jul 28 00:39:41 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:39:41</nova:creationTime>
Jul 28 00:39:41 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:39:41 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:39:41 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:39:41 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:39:41 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:39:41 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:39:41 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:39:41 user nova-compute[70709]:       <nova:owner>
Jul 28 00:39:41 user nova-compute[70709]:         <nova:user uuid="3e898b8e480e4d40a8e40beec39f2b66">tempest-SnapshotDataIntegrityTests-2056239659-project-member</nova:user>
Jul 28 00:39:41 user nova-compute[70709]:         <nova:project uuid="578e5b0ed17745a188b54c44f426eca9">tempest-SnapshotDataIntegrityTests-2056239659</nova:project>
Jul 28 00:39:41 user nova-compute[70709]:       </nova:owner>
Jul 28 00:39:41 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:39:41 user nova-compute[70709]:       <nova:ports>
Jul 28 00:39:41 user nova-compute[70709]:         <nova:port uuid="0ee4a18f-b92b-4bff-930f-0815d6962257">
Jul 28 00:39:41 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 28 00:39:41 user nova-compute[70709]:         </nova:port>
Jul 28 00:39:41 user nova-compute[70709]:       </nova:ports>
Jul 28 00:39:41 user nova-compute[70709]:     </nova:instance>
Jul 28 00:39:41 user nova-compute[70709]:   </metadata>
Jul 28 00:39:41 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:39:41 user nova-compute[70709]:     <system>
Jul 28 00:39:41 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:39:41 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:39:41 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:39:41 user nova-compute[70709]:       <entry name="serial">4658dea2-f6e3-47db-8e37-97d64c70fe4c</entry>
Jul 28 00:39:41 user nova-compute[70709]:       <entry name="uuid">4658dea2-f6e3-47db-8e37-97d64c70fe4c</entry>
Jul 28 00:39:41 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:39:41 user nova-compute[70709]:     </system>
Jul 28 00:39:41 user nova-compute[70709]:   </sysinfo>
Jul 28 00:39:41 user nova-compute[70709]:   <os>
Jul 28 00:39:41 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:39:41 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:39:41 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:39:41 user nova-compute[70709]:   </os>
Jul 28 00:39:41 user nova-compute[70709]:   <features>
Jul 28 00:39:41 user nova-compute[70709]:     <acpi/>
Jul 28 00:39:41 user nova-compute[70709]:     <apic/>
Jul 28 00:39:41 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:39:41 user nova-compute[70709]:   </features>
Jul 28 00:39:41 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:39:41 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:39:41 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:39:41 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:39:41 user nova-compute[70709]:   </clock>
Jul 28 00:39:41 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:39:41 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:39:41 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:39:41 user nova-compute[70709]:   </cpu>
Jul 28 00:39:41 user nova-compute[70709]:   <devices>
Jul 28 00:39:41 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:39:41 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:39:41 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk"/>
Jul 28 00:39:41 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:39:41 user nova-compute[70709]:     </disk>
Jul 28 00:39:41 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:39:41 user nova-compute[70709]:       <mac address="fa:16:3e:01:51:d2"/>
Jul 28 00:39:41 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:39:41 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:39:41 user nova-compute[70709]:       <target dev="tap0ee4a18f-b9"/>
Jul 28 00:39:41 user nova-compute[70709]:     </interface>
Jul 28 00:39:41 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:39:41 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/console.log" append="off"/>
Jul 28 00:39:41 user nova-compute[70709]:     </serial>
Jul 28 00:39:41 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:39:41 user nova-compute[70709]:     <video>
Jul 28 00:39:41 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:39:41 user nova-compute[70709]:     </video>
Jul 28 00:39:41 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:39:41 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:39:41 user nova-compute[70709]:     </rng>
Jul 28 00:39:41 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:39:41 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:39:41 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:39:41 user nova-compute[70709]:     </memballoon>
Jul 28 00:39:41 user nova-compute[70709]:   </devices>
Jul 28 00:39:41 user nova-compute[70709]: </domain>
Jul 28 00:39:41 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-112727453',display_name='tempest-SnapshotDataIntegrityTests-server-112727453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-112727453',id=45,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUDG6krpW8/YAljBawVWqsAhNlfZT3/ppckXM//SxebFynWqAYbE8xpGFLrxvAEdm2hcC31TWWTZqLO1yZRzQTyKnla3B3+M2xI4EJf9ejzlO1nEX7skLbhhZgxF3vDmg==',key_name='tempest-keypair-1021118189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='578e5b0ed17745a188b54c44f426eca9',ramdisk_id='',reservation_id='r-3p9k3bjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2056239659',owner_user_name='tempest-SnapshotDataIntegrityTests-2056239659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e898b8e480e4d40a8e40beec39f2b66',uuid=4658dea2-f6e3-47db-8e37-97d64c70fe4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Converting VIF {"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ee4a18f-b92b-4bff-930f-0815d6962257,network=Network(66d15025-063a-47d7-9a20-086bf8e56d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee4a18f-b9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG os_vif [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ee4a18f-b92b-4bff-930f-0815d6962257,network=Network(66d15025-063a-47d7-9a20-086bf8e56d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee4a18f-b9') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ee4a18f-b9, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ee4a18f-b9, col_values=(('external_ids', {'iface-id': '0ee4a18f-b92b-4bff-930f-0815d6962257', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:51:d2', 'vm-uuid': '4658dea2-f6e3-47db-8e37-97d64c70fe4c'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:41 user nova-compute[70709]: INFO os_vif [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ee4a18f-b92b-4bff-930f-0815d6962257,network=Network(66d15025-063a-47d7-9a20-086bf8e56d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee4a18f-b9')
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No VIF found with MAC fa:16:3e:01:51:d2, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-f002acc9-ee56-47ab-b00e-59223be298b7 req-fd11743e-acbf-4bc1-bf9b-6cb39d9b1fbc service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updated VIF entry in instance network info cache for port 0ee4a18f-b92b-4bff-930f-0815d6962257. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG nova.network.neutron [req-f002acc9-ee56-47ab-b00e-59223be298b7 req-fd11743e-acbf-4bc1-bf9b-6cb39d9b1fbc service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updating instance_info_cache with network_info: [{"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:39:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f002acc9-ee56-47ab-b00e-59223be298b7 req-fd11743e-acbf-4bc1-bf9b-6cb39d9b1fbc service nova] Releasing lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:39:42 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updating instance_info_cache with network_info: [{"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:39:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:39:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:39:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-ce98b5c7-3f24-4379-a313-c39d5c6c8849 req-eaf4d08e-081e-4981-90bf-86d94968446f service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Received event network-vif-plugged-0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:39:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ce98b5c7-3f24-4379-a313-c39d5c6c8849 req-eaf4d08e-081e-4981-90bf-86d94968446f service nova] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ce98b5c7-3f24-4379-a313-c39d5c6c8849 req-eaf4d08e-081e-4981-90bf-86d94968446f service nova] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ce98b5c7-3f24-4379-a313-c39d5c6c8849 req-eaf4d08e-081e-4981-90bf-86d94968446f service nova] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-ce98b5c7-3f24-4379-a313-c39d5c6c8849 req-eaf4d08e-081e-4981-90bf-86d94968446f service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] No waiting events found dispatching network-vif-plugged-0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:39:43 user nova-compute[70709]: WARNING nova.compute.manager [req-ce98b5c7-3f24-4379-a313-c39d5c6c8849 req-eaf4d08e-081e-4981-90bf-86d94968446f service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Received unexpected event network-vif-plugged-0ee4a18f-b92b-4bff-930f-0815d6962257 for instance with vm_state building and task_state spawning.
Jul 28 00:39:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504785.0547597, 4658dea2-f6e3-47db-8e37-97d64c70fe4c => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:39:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] VM Resumed (Lifecycle Event)
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:39:45 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Instance spawned successfully.
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:39:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504785.0559292, 4658dea2-f6e3-47db-8e37-97d64c70fe4c => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:39:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] VM Started (Lifecycle Event)
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:39:45 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:39:45 user nova-compute[70709]: INFO nova.compute.manager [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Took 6.16 seconds to spawn the instance on the hypervisor.
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-ad1ce1e4-2a5f-4f9b-92d1-e1d0b2146b6e req-428584e4-e3b5-47bd-92c8-8e1d2d4737bc service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Received event network-vif-plugged-0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ad1ce1e4-2a5f-4f9b-92d1-e1d0b2146b6e req-428584e4-e3b5-47bd-92c8-8e1d2d4737bc service nova] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ad1ce1e4-2a5f-4f9b-92d1-e1d0b2146b6e req-428584e4-e3b5-47bd-92c8-8e1d2d4737bc service nova] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ad1ce1e4-2a5f-4f9b-92d1-e1d0b2146b6e req-428584e4-e3b5-47bd-92c8-8e1d2d4737bc service nova] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-ad1ce1e4-2a5f-4f9b-92d1-e1d0b2146b6e req-428584e4-e3b5-47bd-92c8-8e1d2d4737bc service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] No waiting events found dispatching network-vif-plugged-0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:39:45 user nova-compute[70709]: WARNING nova.compute.manager [req-ad1ce1e4-2a5f-4f9b-92d1-e1d0b2146b6e req-428584e4-e3b5-47bd-92c8-8e1d2d4737bc service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Received unexpected event network-vif-plugged-0ee4a18f-b92b-4bff-930f-0815d6962257 for instance with vm_state building and task_state spawning.
Jul 28 00:39:45 user nova-compute[70709]: INFO nova.compute.manager [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Took 6.96 seconds to build instance.
Jul 28 00:39:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-54dbfdfa-13d1-409b-affe-1516ca2252bc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.047s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:39:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:39:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:39:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:39:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:57 user nova-compute[70709]: INFO nova.compute.manager [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Rescuing
Jul 28 00:39:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:39:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquired lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:39:57 user nova-compute[70709]: DEBUG nova.network.neutron [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG nova.network.neutron [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updating instance_info_cache with network_info: [{"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Releasing lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-b3443949-c69c-452b-b4a6-58203bef66cc req-fecdfdc1-cbb5-4de4-9a98-fcf4507db839 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-unplugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3443949-c69c-452b-b4a6-58203bef66cc req-fecdfdc1-cbb5-4de4-9a98-fcf4507db839 service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3443949-c69c-452b-b4a6-58203bef66cc req-fecdfdc1-cbb5-4de4-9a98-fcf4507db839 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b3443949-c69c-452b-b4a6-58203bef66cc req-fecdfdc1-cbb5-4de4-9a98-fcf4507db839 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-b3443949-c69c-452b-b4a6-58203bef66cc req-fecdfdc1-cbb5-4de4-9a98-fcf4507db839 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-unplugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:39:58 user nova-compute[70709]: WARNING nova.compute.manager [req-b3443949-c69c-452b-b4a6-58203bef66cc req-fecdfdc1-cbb5-4de4-9a98-fcf4507db839 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received unexpected event network-vif-unplugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with vm_state active and task_state rescuing.
Jul 28 00:39:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:39:58 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Instance destroyed successfully.
Jul 28 00:39:58 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Attempting rescue
Jul 28 00:39:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70709) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Instance directory exists: not creating {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 28 00:39:58 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Creating image(s)
Jul 28 00:39:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "/opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG nova.objects.instance [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'trusted_certs' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:39:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.rescue {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.rescue" returned: 0 in 0.047s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.objects.instance [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'migration_context' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Start _get_guest_xml network_info=[{"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "vif_mac": "fa:16:3e:b6:9c:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.objects.instance [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'resources' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.objects.instance [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'numa_topology' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:59 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:39:59 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.objects.instance [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'vcpu_model' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2111279381',display_name='tempest-ServerRescueNegativeTestJSON-server-2111279381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2111279381',id=40,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:35:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-8jk89xcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:35:20Z,user_data=None,user_id='d8afed76354148e290f0b4f602616818',uuid=96099a70-86f0-4f81-877a-2f30c8c126f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "vif_mac": "fa:16:3e:b6:9c:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "vif_mac": "fa:16:3e:b6:9c:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9c:31,bridge_name='br-int',has_traffic_filtering=True,id=2b266b04-6203-458a-b727-e7f2e4ab00a7,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b266b04-62') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.objects.instance [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'pci_devices' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:39:59 user nova-compute[70709]:   <uuid>96099a70-86f0-4f81-877a-2f30c8c126f8</uuid>
Jul 28 00:39:59 user nova-compute[70709]:   <name>instance-00000028</name>
Jul 28 00:39:59 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:39:59 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:39:59 user nova-compute[70709]:   <metadata>
Jul 28 00:39:59 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:39:59 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:39:59 user nova-compute[70709]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2111279381</nova:name>
Jul 28 00:39:59 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:39:59</nova:creationTime>
Jul 28 00:39:59 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:39:59 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:39:59 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:39:59 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:39:59 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:39:59 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:39:59 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:39:59 user nova-compute[70709]:       <nova:owner>
Jul 28 00:39:59 user nova-compute[70709]:         <nova:user uuid="d8afed76354148e290f0b4f602616818">tempest-ServerRescueNegativeTestJSON-1040689578-project-member</nova:user>
Jul 28 00:39:59 user nova-compute[70709]:         <nova:project uuid="ad38eeba09ce4551899f892ea787ea1c">tempest-ServerRescueNegativeTestJSON-1040689578</nova:project>
Jul 28 00:39:59 user nova-compute[70709]:       </nova:owner>
Jul 28 00:39:59 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:39:59 user nova-compute[70709]:       <nova:ports>
Jul 28 00:39:59 user nova-compute[70709]:         <nova:port uuid="2b266b04-6203-458a-b727-e7f2e4ab00a7">
Jul 28 00:39:59 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 28 00:39:59 user nova-compute[70709]:         </nova:port>
Jul 28 00:39:59 user nova-compute[70709]:       </nova:ports>
Jul 28 00:39:59 user nova-compute[70709]:     </nova:instance>
Jul 28 00:39:59 user nova-compute[70709]:   </metadata>
Jul 28 00:39:59 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:39:59 user nova-compute[70709]:     <system>
Jul 28 00:39:59 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:39:59 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:39:59 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:39:59 user nova-compute[70709]:       <entry name="serial">96099a70-86f0-4f81-877a-2f30c8c126f8</entry>
Jul 28 00:39:59 user nova-compute[70709]:       <entry name="uuid">96099a70-86f0-4f81-877a-2f30c8c126f8</entry>
Jul 28 00:39:59 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:39:59 user nova-compute[70709]:     </system>
Jul 28 00:39:59 user nova-compute[70709]:   </sysinfo>
Jul 28 00:39:59 user nova-compute[70709]:   <os>
Jul 28 00:39:59 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:39:59 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:39:59 user nova-compute[70709]:   </os>
Jul 28 00:39:59 user nova-compute[70709]:   <features>
Jul 28 00:39:59 user nova-compute[70709]:     <acpi/>
Jul 28 00:39:59 user nova-compute[70709]:     <apic/>
Jul 28 00:39:59 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:39:59 user nova-compute[70709]:   </features>
Jul 28 00:39:59 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:39:59 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:39:59 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:39:59 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:39:59 user nova-compute[70709]:   </clock>
Jul 28 00:39:59 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:39:59 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:39:59 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:39:59 user nova-compute[70709]:   </cpu>
Jul 28 00:39:59 user nova-compute[70709]:   <devices>
Jul 28 00:39:59 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:39:59 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:39:59 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.rescue"/>
Jul 28 00:39:59 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:39:59 user nova-compute[70709]:     </disk>
Jul 28 00:39:59 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:39:59 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:39:59 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk"/>
Jul 28 00:39:59 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:39:59 user nova-compute[70709]:     </disk>
Jul 28 00:39:59 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:39:59 user nova-compute[70709]:       <mac address="fa:16:3e:b6:9c:31"/>
Jul 28 00:39:59 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:39:59 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:39:59 user nova-compute[70709]:       <target dev="tap2b266b04-62"/>
Jul 28 00:39:59 user nova-compute[70709]:     </interface>
Jul 28 00:39:59 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:39:59 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/console.log" append="off"/>
Jul 28 00:39:59 user nova-compute[70709]:     </serial>
Jul 28 00:39:59 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:39:59 user nova-compute[70709]:     <video>
Jul 28 00:39:59 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:39:59 user nova-compute[70709]:     </video>
Jul 28 00:39:59 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:39:59 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:39:59 user nova-compute[70709]:     </rng>
Jul 28 00:39:59 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:39:59 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:39:59 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:39:59 user nova-compute[70709]:     </memballoon>
Jul 28 00:39:59 user nova-compute[70709]:   </devices>
Jul 28 00:39:59 user nova-compute[70709]: </domain>
Jul 28 00:39:59 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:39:59 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Instance destroyed successfully.
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:39:59 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No VIF found with MAC fa:16:3e:b6:9c:31, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:40:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-589df198-c66f-4831-a918-580b0bc8bbe9 req-a4aa603e-c4ce-49de-928a-26a66e94e169 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-589df198-c66f-4831-a918-580b0bc8bbe9 req-a4aa603e-c4ce-49de-928a-26a66e94e169 service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-589df198-c66f-4831-a918-580b0bc8bbe9 req-a4aa603e-c4ce-49de-928a-26a66e94e169 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-589df198-c66f-4831-a918-580b0bc8bbe9 req-a4aa603e-c4ce-49de-928a-26a66e94e169 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-589df198-c66f-4831-a918-580b0bc8bbe9 req-a4aa603e-c4ce-49de-928a-26a66e94e169 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:40:00 user nova-compute[70709]: WARNING nova.compute.manager [req-589df198-c66f-4831-a918-580b0bc8bbe9 req-a4aa603e-c4ce-49de-928a-26a66e94e169 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received unexpected event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with vm_state active and task_state rescuing.
Jul 28 00:40:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:40:02 user nova-compute[70709]: WARNING nova.compute.manager [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received unexpected event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with vm_state active and task_state rescuing.
Jul 28 00:40:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:02 user nova-compute[70709]: DEBUG nova.compute.manager [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:40:02 user nova-compute[70709]: WARNING nova.compute.manager [req-f82b853c-c0b1-42f6-bd35-9e6b85edfbc8 req-b773edf1-afa7-4a50-987a-775ae38bc274 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received unexpected event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with vm_state active and task_state rescuing.
Jul 28 00:40:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for 96099a70-86f0-4f81-877a-2f30c8c126f8 due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:40:03 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504803.2229965, 96099a70-86f0-4f81-877a-2f30c8c126f8 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:40:03 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] VM Resumed (Lifecycle Event)
Jul 28 00:40:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-0ab4311c-5b8d-457b-9339-daaeb396b292 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:40:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:40:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:40:03 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 28 00:40:03 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504803.224926, 96099a70-86f0-4f81-877a-2f30c8c126f8 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:40:03 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] VM Started (Lifecycle Event)
Jul 28 00:40:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:40:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:40:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-acacfdf6-0092-43fe-a38a-f316467e1caf req-dbbcd91c-05d2-4432-b562-e2bf55b5db02 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received event network-changed-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-acacfdf6-0092-43fe-a38a-f316467e1caf req-dbbcd91c-05d2-4432-b562-e2bf55b5db02 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Refreshing instance network info cache due to event network-changed-e60f73f2-f87f-4b47-acbd-78ec506ba37e. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-acacfdf6-0092-43fe-a38a-f316467e1caf req-dbbcd91c-05d2-4432-b562-e2bf55b5db02 service nova] Acquiring lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-acacfdf6-0092-43fe-a38a-f316467e1caf req-dbbcd91c-05d2-4432-b562-e2bf55b5db02 service nova] Acquired lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG nova.network.neutron [req-acacfdf6-0092-43fe-a38a-f316467e1caf req-dbbcd91c-05d2-4432-b562-e2bf55b5db02 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Refreshing network info cache for port e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:17 user nova-compute[70709]: INFO nova.compute.manager [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Terminating instance
Jul 28 00:40:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:40:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-d32cc921-0fc9-4f89-940b-167e0fe2ae7c req-91519d39-5365-441b-936f-7568afec1c29 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received event network-vif-unplugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d32cc921-0fc9-4f89-940b-167e0fe2ae7c req-91519d39-5365-441b-936f-7568afec1c29 service nova] Acquiring lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d32cc921-0fc9-4f89-940b-167e0fe2ae7c req-91519d39-5365-441b-936f-7568afec1c29 service nova] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d32cc921-0fc9-4f89-940b-167e0fe2ae7c req-91519d39-5365-441b-936f-7568afec1c29 service nova] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-d32cc921-0fc9-4f89-940b-167e0fe2ae7c req-91519d39-5365-441b-936f-7568afec1c29 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] No waiting events found dispatching network-vif-unplugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-d32cc921-0fc9-4f89-940b-167e0fe2ae7c req-91519d39-5365-441b-936f-7568afec1c29 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received event network-vif-unplugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG nova.network.neutron [req-acacfdf6-0092-43fe-a38a-f316467e1caf req-dbbcd91c-05d2-4432-b562-e2bf55b5db02 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Updated VIF entry in instance network info cache for port e60f73f2-f87f-4b47-acbd-78ec506ba37e. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG nova.network.neutron [req-acacfdf6-0092-43fe-a38a-f316467e1caf req-dbbcd91c-05d2-4432-b562-e2bf55b5db02 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Updating instance_info_cache with network_info: [{"id": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "address": "fa:16:3e:d1:21:94", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60f73f2-f8", "ovs_interfaceid": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-acacfdf6-0092-43fe-a38a-f316467e1caf req-dbbcd91c-05d2-4432-b562-e2bf55b5db02 service nova] Releasing lock "refresh_cache-00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:40:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Instance destroyed successfully.
Jul 28 00:40:18 user nova-compute[70709]: DEBUG nova.objects.instance [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'resources' on Instance uuid 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-355782394',display_name='tempest-TestStampPattern-server-355782394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-355782394',id=43,image_ref='6cbe13b4-6491-4101-bda9-f8573bb243db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbIsegpiueygcqxDMoqSRPiFzCAnNCeyeO9o7pyraW7IRIG5BvGlYKQLMkQxKgoyxaQdPTaJ/Hf8m0otg97bnUyVJ7NJ5OuhJ+tpoBcvNHMqX4UEk5LyzatE/ojR/Gr9A==',key_name='tempest-TestStampPattern-1821279517',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:37:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cda75c307259403282f8d98700806f24',ramdisk_id='',reservation_id='r-ci6x3fcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0f2efeca-74ee-4d4b-a591-8cd8298d7ceb',image_min_disk='1',image_min_ram='0',image_owner_id='cda75c307259403282f8d98700806f24',image_owner_project_name='tempest-TestStampPattern-734847133',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-734847133-project-member',image_user_id='c4f5d7ab7bc9485da7b82444b9bd4d0a',owner_project_name='tempest-TestStampPattern-734847133',owner_user_name='tempest-TestStampPattern-734847133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:37:31Z,user_data=None,user_id='c4f5d7ab7bc9485da7b82444b9bd4d0a',uuid=00222c42-f9a0-4a9a-afcd-30aa11b3a8f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "address": "fa:16:3e:d1:21:94", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60f73f2-f8", "ovs_interfaceid": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converting VIF {"id": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "address": "fa:16:3e:d1:21:94", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60f73f2-f8", "ovs_interfaceid": "e60f73f2-f87f-4b47-acbd-78ec506ba37e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:21:94,bridge_name='br-int',has_traffic_filtering=True,id=e60f73f2-f87f-4b47-acbd-78ec506ba37e,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60f73f2-f8') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG os_vif [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:21:94,bridge_name='br-int',has_traffic_filtering=True,id=e60f73f2-f87f-4b47-acbd-78ec506ba37e,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60f73f2-f8') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape60f73f2-f8, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:18 user nova-compute[70709]: INFO os_vif [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:21:94,bridge_name='br-int',has_traffic_filtering=True,id=e60f73f2-f87f-4b47-acbd-78ec506ba37e,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60f73f2-f8')
Jul 28 00:40:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Deleting instance files /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6_del
Jul 28 00:40:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Deletion of /opt/stack/data/nova/instances/00222c42-f9a0-4a9a-afcd-30aa11b3a8f6_del complete
Jul 28 00:40:18 user nova-compute[70709]: INFO nova.compute.manager [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 28 00:40:18 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:40:18 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:40:19 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:40:19 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Took 0.50 seconds to deallocate network for instance.
Jul 28 00:40:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-84f97354-bb15-4399-bc3c-418116138222 req-515fa0f9-0990-42db-92c6-0f32f18d7856 service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received event network-vif-deleted-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:19 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:40:19 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:40:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:19 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Deleted allocations for instance 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6
Jul 28 00:40:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3553d544-0871-4be9-9709-c57ce97af3cf tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.772s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-0f256ac2-ae5c-4d3a-8db2-dd09a75cbd11 req-145f9212-6a33-46a4-84a1-7d291b973e9f service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received event network-vif-plugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0f256ac2-ae5c-4d3a-8db2-dd09a75cbd11 req-145f9212-6a33-46a4-84a1-7d291b973e9f service nova] Acquiring lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0f256ac2-ae5c-4d3a-8db2-dd09a75cbd11 req-145f9212-6a33-46a4-84a1-7d291b973e9f service nova] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0f256ac2-ae5c-4d3a-8db2-dd09a75cbd11 req-145f9212-6a33-46a4-84a1-7d291b973e9f service nova] Lock "00222c42-f9a0-4a9a-afcd-30aa11b3a8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-0f256ac2-ae5c-4d3a-8db2-dd09a75cbd11 req-145f9212-6a33-46a4-84a1-7d291b973e9f service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] No waiting events found dispatching network-vif-plugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:40:20 user nova-compute[70709]: WARNING nova.compute.manager [req-0f256ac2-ae5c-4d3a-8db2-dd09a75cbd11 req-145f9212-6a33-46a4-84a1-7d291b973e9f service nova] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Received unexpected event network-vif-plugged-e60f73f2-f87f-4b47-acbd-78ec506ba37e for instance with vm_state deleted and task_state None.
Jul 28 00:40:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 00:40:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:28 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:29 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:40:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:40:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:32 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:40:32 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:40:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8176MB free_disk=25.10926055908203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 0455687d-6492-40dd-b636-c6a7f8760184 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:40:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:33 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504818.6909132, 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:40:33 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] VM Stopped (Lifecycle Event)
Jul 28 00:40:33 user nova-compute[70709]: DEBUG nova.compute.manager [None req-4b0cd22d-38f3-49f5-8fca-cf7f9829d4a3 None None] [instance: 00222c42-f9a0-4a9a-afcd-30aa11b3a8f6] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:40:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:34 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:34 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:40:35 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:40:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:40:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:40:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:40:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:40:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:40 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 4d016cd1-fe5e-4ec9-9105-5450d99c9599 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 0455687d-6492-40dd-b636-c6a7f8760184 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "0455687d-6492-40dd-b636-c6a7f8760184" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "0455687d-6492-40dd-b636-c6a7f8760184" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:40:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:40:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:40:49 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:49 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 00:40:49 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 00:40:52 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:40:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG nova.compute.manager [req-ca0d1399-87de-4fab-8b05-aa88a1c48a9b req-865e9dd2-2605-4c1b-a3c2-8dffacfc2603 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-changed-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG nova.compute.manager [req-ca0d1399-87de-4fab-8b05-aa88a1c48a9b req-865e9dd2-2605-4c1b-a3c2-8dffacfc2603 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Refreshing instance network info cache due to event network-changed-0b260b36-5ee9-45b3-aba6-1c123dd96f14. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ca0d1399-87de-4fab-8b05-aa88a1c48a9b req-865e9dd2-2605-4c1b-a3c2-8dffacfc2603 service nova] Acquiring lock "refresh_cache-0455687d-6492-40dd-b636-c6a7f8760184" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ca0d1399-87de-4fab-8b05-aa88a1c48a9b req-865e9dd2-2605-4c1b-a3c2-8dffacfc2603 service nova] Acquired lock "refresh_cache-0455687d-6492-40dd-b636-c6a7f8760184" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG nova.network.neutron [req-ca0d1399-87de-4fab-8b05-aa88a1c48a9b req-865e9dd2-2605-4c1b-a3c2-8dffacfc2603 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Refreshing network info cache for port 0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG nova.network.neutron [req-ca0d1399-87de-4fab-8b05-aa88a1c48a9b req-865e9dd2-2605-4c1b-a3c2-8dffacfc2603 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Updated VIF entry in instance network info cache for port 0b260b36-5ee9-45b3-aba6-1c123dd96f14. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG nova.network.neutron [req-ca0d1399-87de-4fab-8b05-aa88a1c48a9b req-865e9dd2-2605-4c1b-a3c2-8dffacfc2603 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Updating instance_info_cache with network_info: [{"id": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "address": "fa:16:3e:19:95:8a", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b260b36-5e", "ovs_interfaceid": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ca0d1399-87de-4fab-8b05-aa88a1c48a9b req-865e9dd2-2605-4c1b-a3c2-8dffacfc2603 service nova] Releasing lock "refresh_cache-0455687d-6492-40dd-b636-c6a7f8760184" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "0455687d-6492-40dd-b636-c6a7f8760184" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:55 user nova-compute[70709]: INFO nova.compute.manager [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Terminating instance
Jul 28 00:40:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:56 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Instance destroyed successfully.
Jul 28 00:40:56 user nova-compute[70709]: DEBUG nova.objects.instance [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'resources' on Instance uuid 0455687d-6492-40dd-b636-c6a7f8760184 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1291075343',display_name='tempest-TestVolumeBootPattern-server-1291075343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1291075343',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJASKlujGBh7q4FjBKCwUDBKdkAi9ZlmeDUwzkD1Smbvo/bJjZcXJHiVRyG3yLb9/84JrQ3NFZZ8DFC79UmemaYV3pBVbiAP8M5fiEEtqWcYd/Pk5XyfaCP8BM8JvkX0XQ==',key_name='tempest-TestVolumeBootPattern-248605266',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:39:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-mnoa7enj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:39:15Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=0455687d-6492-40dd-b636-c6a7f8760184,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "address": "fa:16:3e:19:95:8a", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b260b36-5e", "ovs_interfaceid": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "address": "fa:16:3e:19:95:8a", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b260b36-5e", "ovs_interfaceid": "0b260b36-5ee9-45b3-aba6-1c123dd96f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0b260b36-5ee9-45b3-aba6-1c123dd96f14,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b260b36-5e') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_vif [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0b260b36-5ee9-45b3-aba6-1c123dd96f14,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b260b36-5e') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b260b36-5e, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:56 user nova-compute[70709]: INFO os_vif [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0b260b36-5ee9-45b3-aba6-1c123dd96f14,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b260b36-5e')
Jul 28 00:40:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzKoQUxu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:40:56 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[64802311-f2fb-41e7-8ae6-5ef85b8241bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:40:56 user nova-compute[70709]: No targets found.
Jul 28 00:40:56 user nova-compute[70709]: iSNS:
Jul 28 00:40:56 user nova-compute[70709]: No targets found.
Jul 28 00:40:56 user nova-compute[70709]: STATIC:
Jul 28 00:40:56 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d
Jul 28 00:40:56 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:40:56 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:40:56 user nova-compute[70709]: FIRMWARE:
Jul 28 00:40:56 user nova-compute[70709]: No targets found.
Jul 28 00:40:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:40:56 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:40:56 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fbc1ec-a2d9-4f8c-858f-a33cd3397b50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fb7ae5-c4f4-40f6-a0d4-5e5395b5e3c1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:40:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:40:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90332c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d'): ({'sdb'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Removing single pathed devices sdb {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f230459-9c03-4511-8723-b428c227bb71]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5023f675-0fce-4066-9aa5-772f7085a101]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flushing IO for device /dev/sdb {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2646344-be1e-40c8-8d31-52f65c09b2d0]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[52384176-d0cc-4076-8ad9-4730f7b11fc9]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ba40a532', '/dev/disk/by-id/scsi-1SCST_BIOba40a532-141e014289384a80', '/dev/disk/by-id/scsi-23134316530313432') {{(pid=82455) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b4ca43-2199-4c25-81b9-50e2860025de]: (4, None) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43368dd-9478-4810-bf1b-c0e7cbbd1ff0]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb9181f-3aee-4496-a694-a23456174923]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260]
Jul 28 00:40:56 user nova-compute[70709]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260] successful.
Jul 28 00:40:56 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f6158-b97f-4d32-bf18-bb68f10ae643]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== disconnect_volume: return (321ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:40:56 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Deleting instance files /opt/stack/data/nova/instances/0455687d-6492-40dd-b636-c6a7f8760184_del
Jul 28 00:40:56 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Deletion of /opt/stack/data/nova/instances/0455687d-6492-40dd-b636-c6a7f8760184_del complete
Jul 28 00:40:56 user nova-compute[70709]: INFO nova.compute.manager [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 28 00:40:56 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-vif-unplugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] No waiting events found dispatching network-vif-unplugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-vif-unplugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] No waiting events found dispatching network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:40:57 user nova-compute[70709]: WARNING nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received unexpected event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 for instance with vm_state active and task_state deleting.
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] No waiting events found dispatching network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:40:57 user nova-compute[70709]: WARNING nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received unexpected event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 for instance with vm_state active and task_state deleting.
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] No waiting events found dispatching network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:40:57 user nova-compute[70709]: WARNING nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received unexpected event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 for instance with vm_state active and task_state deleting.
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-vif-unplugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] No waiting events found dispatching network-vif-unplugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-cb454498-ffdd-4854-b648-927ee1ed32c7 req-c89ed4b4-e8bb-4dff-b46e-7a28caeae9a5 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-vif-unplugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:40:57 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Took 1.11 seconds to deallocate network for instance.
Jul 28 00:40:57 user nova-compute[70709]: DEBUG nova.compute.manager [req-f29cd344-d5b3-41c2-88b1-028326e1077b req-42b57441-ac48-47a8-b6f4-a9229e8a4bc7 service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-vif-deleted-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:40:58 user nova-compute[70709]: INFO nova.compute.manager [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Took 0.73 seconds to detach 1 volumes for instance.
Jul 28 00:40:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:58 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:40:58 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:40:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:58 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Deleted allocations for instance 0455687d-6492-40dd-b636-c6a7f8760184
Jul 28 00:40:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ac1164ec-0cd6-4604-8c54-637e774fcc83 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "0455687d-6492-40dd-b636-c6a7f8760184" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.420s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-e0631aa9-a7f4-434f-8d57-7c2ccc7d1cc0 req-b9d245a0-15ad-47df-82b7-bc498805267a service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:40:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e0631aa9-a7f4-434f-8d57-7c2ccc7d1cc0 req-b9d245a0-15ad-47df-82b7-bc498805267a service nova] Acquiring lock "0455687d-6492-40dd-b636-c6a7f8760184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:40:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e0631aa9-a7f4-434f-8d57-7c2ccc7d1cc0 req-b9d245a0-15ad-47df-82b7-bc498805267a service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:40:59 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e0631aa9-a7f4-434f-8d57-7c2ccc7d1cc0 req-b9d245a0-15ad-47df-82b7-bc498805267a service nova] Lock "0455687d-6492-40dd-b636-c6a7f8760184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:40:59 user nova-compute[70709]: DEBUG nova.compute.manager [req-e0631aa9-a7f4-434f-8d57-7c2ccc7d1cc0 req-b9d245a0-15ad-47df-82b7-bc498805267a service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] No waiting events found dispatching network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:40:59 user nova-compute[70709]: WARNING nova.compute.manager [req-e0631aa9-a7f4-434f-8d57-7c2ccc7d1cc0 req-b9d245a0-15ad-47df-82b7-bc498805267a service nova] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Received unexpected event network-vif-plugged-0b260b36-5ee9-45b3-aba6-1c123dd96f14 for instance with vm_state deleted and task_state None.
Jul 28 00:41:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:41:11 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504856.350778, 0455687d-6492-40dd-b636-c6a7f8760184 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:41:11 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] VM Stopped (Lifecycle Event)
Jul 28 00:41:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bf1564d3-ee53-43a7-a6e6-be469bf030a5 None None] [instance: 0455687d-6492-40dd-b636-c6a7f8760184] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:41:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:41:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:41:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:41:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:41:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-74ec1477-2ce5-4f1a-8155-69636ab753aa req-986675a6-91f5-497f-a1ba-bc80b224788f service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received event network-changed-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:41:17 user nova-compute[70709]: DEBUG nova.compute.manager [req-74ec1477-2ce5-4f1a-8155-69636ab753aa req-986675a6-91f5-497f-a1ba-bc80b224788f service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Refreshing instance network info cache due to event network-changed-1264a609-d490-4daa-9641-b722999ed799. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:41:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-74ec1477-2ce5-4f1a-8155-69636ab753aa req-986675a6-91f5-497f-a1ba-bc80b224788f service nova] Acquiring lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:41:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-74ec1477-2ce5-4f1a-8155-69636ab753aa req-986675a6-91f5-497f-a1ba-bc80b224788f service nova] Acquired lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:41:17 user nova-compute[70709]: DEBUG nova.network.neutron [req-74ec1477-2ce5-4f1a-8155-69636ab753aa req-986675a6-91f5-497f-a1ba-bc80b224788f service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Refreshing network info cache for port 1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:18 user nova-compute[70709]: INFO nova.compute.manager [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Terminating instance
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-42253fd9-97a3-4ddf-822d-aa4506829bb2 req-2294d11b-a873-4e67-a489-cba98f40d187 service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received event network-vif-unplugged-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-42253fd9-97a3-4ddf-822d-aa4506829bb2 req-2294d11b-a873-4e67-a489-cba98f40d187 service nova] Acquiring lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-42253fd9-97a3-4ddf-822d-aa4506829bb2 req-2294d11b-a873-4e67-a489-cba98f40d187 service nova] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-42253fd9-97a3-4ddf-822d-aa4506829bb2 req-2294d11b-a873-4e67-a489-cba98f40d187 service nova] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-42253fd9-97a3-4ddf-822d-aa4506829bb2 req-2294d11b-a873-4e67-a489-cba98f40d187 service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] No waiting events found dispatching network-vif-unplugged-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-42253fd9-97a3-4ddf-822d-aa4506829bb2 req-2294d11b-a873-4e67-a489-cba98f40d187 service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received event network-vif-unplugged-1264a609-d490-4daa-9641-b722999ed799 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.network.neutron [req-74ec1477-2ce5-4f1a-8155-69636ab753aa req-986675a6-91f5-497f-a1ba-bc80b224788f service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Updated VIF entry in instance network info cache for port 1264a609-d490-4daa-9641-b722999ed799. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.network.neutron [req-74ec1477-2ce5-4f1a-8155-69636ab753aa req-986675a6-91f5-497f-a1ba-bc80b224788f service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Updating instance_info_cache with network_info: [{"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-74ec1477-2ce5-4f1a-8155-69636ab753aa req-986675a6-91f5-497f-a1ba-bc80b224788f service nova] Releasing lock "refresh_cache-0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Instance destroyed successfully.
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.objects.instance [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lazy-loading 'resources' on Instance uuid 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1757599622',display_name='tempest-TestStampPattern-server-1757599622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1757599622',id=39,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbIsegpiueygcqxDMoqSRPiFzCAnNCeyeO9o7pyraW7IRIG5BvGlYKQLMkQxKgoyxaQdPTaJ/Hf8m0otg97bnUyVJ7NJ5OuhJ+tpoBcvNHMqX4UEk5LyzatE/ojR/Gr9A==',key_name='tempest-TestStampPattern-1821279517',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:34:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cda75c307259403282f8d98700806f24',ramdisk_id='',reservation_id='r-frvy901l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-734847133',owner_user_name='tempest-TestStampPattern-734847133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:37:21Z,user_data=None,user_id='c4f5d7ab7bc9485da7b82444b9bd4d0a',uuid=0f2efeca-74ee-4d4b-a591-8cd8298d7ceb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converting VIF {"id": "1264a609-d490-4daa-9641-b722999ed799", "address": "fa:16:3e:76:06:79", "network": {"id": "24a1f692-f632-4e5a-821a-5a4fc6913e71", "bridge": "br-int", "label": "tempest-TestStampPattern-869116976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cda75c307259403282f8d98700806f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264a609-d4", "ovs_interfaceid": "1264a609-d490-4daa-9641-b722999ed799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:06:79,bridge_name='br-int',has_traffic_filtering=True,id=1264a609-d490-4daa-9641-b722999ed799,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264a609-d4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG os_vif [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:06:79,bridge_name='br-int',has_traffic_filtering=True,id=1264a609-d490-4daa-9641-b722999ed799,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264a609-d4') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1264a609-d4, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:41:18 user nova-compute[70709]: INFO os_vif [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:06:79,bridge_name='br-int',has_traffic_filtering=True,id=1264a609-d490-4daa-9641-b722999ed799,network=Network(24a1f692-f632-4e5a-821a-5a4fc6913e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264a609-d4')
Jul 28 00:41:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Deleting instance files /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb_del
Jul 28 00:41:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Deletion of /opt/stack/data/nova/instances/0f2efeca-74ee-4d4b-a591-8cd8298d7ceb_del complete
Jul 28 00:41:18 user nova-compute[70709]: INFO nova.compute.manager [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 28 00:41:18 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:41:18 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:41:19 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:41:19 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Took 0.52 seconds to deallocate network for instance.
Jul 28 00:41:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:19 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:41:19 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:41:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:19 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Deleted allocations for instance 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb
Jul 28 00:41:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-24818601-e116-4375-a3ea-310d7e22feb5 tempest-TestStampPattern-734847133 tempest-TestStampPattern-734847133-project-member] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.747s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-a0c1576c-f380-48fe-a540-2c3b1ee1dcb2 req-2f17988e-f783-487d-b7ee-718306041ab3 service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received event network-vif-deleted-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:41:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-87548cd1-26f2-4afc-a663-abf8a9234038 req-74969a2e-a262-429e-8b1b-9fca948c7c8b service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received event network-vif-plugged-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:41:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-87548cd1-26f2-4afc-a663-abf8a9234038 req-74969a2e-a262-429e-8b1b-9fca948c7c8b service nova] Acquiring lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-87548cd1-26f2-4afc-a663-abf8a9234038 req-74969a2e-a262-429e-8b1b-9fca948c7c8b service nova] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-87548cd1-26f2-4afc-a663-abf8a9234038 req-74969a2e-a262-429e-8b1b-9fca948c7c8b service nova] Lock "0f2efeca-74ee-4d4b-a591-8cd8298d7ceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-87548cd1-26f2-4afc-a663-abf8a9234038 req-74969a2e-a262-429e-8b1b-9fca948c7c8b service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] No waiting events found dispatching network-vif-plugged-1264a609-d490-4daa-9641-b722999ed799 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:41:20 user nova-compute[70709]: WARNING nova.compute.manager [req-87548cd1-26f2-4afc-a663-abf8a9234038 req-74969a2e-a262-429e-8b1b-9fca948c7c8b service nova] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Received unexpected event network-vif-plugged-1264a609-d490-4daa-9641-b722999ed799 for instance with vm_state deleted and task_state None.
Jul 28 00:41:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:26 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:41:28 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:41:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-a580d678-373b-4644-be47-e804d0cc46fb req-c28ba500-d84f-4759-8c0d-454977d23776 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Received event network-changed-0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-a580d678-373b-4644-be47-e804d0cc46fb req-c28ba500-d84f-4759-8c0d-454977d23776 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Refreshing instance network info cache due to event network-changed-0ee4a18f-b92b-4bff-930f-0815d6962257. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a580d678-373b-4644-be47-e804d0cc46fb req-c28ba500-d84f-4759-8c0d-454977d23776 service nova] Acquiring lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a580d678-373b-4644-be47-e804d0cc46fb req-c28ba500-d84f-4759-8c0d-454977d23776 service nova] Acquired lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG nova.network.neutron [req-a580d678-373b-4644-be47-e804d0cc46fb req-c28ba500-d84f-4759-8c0d-454977d23776 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Refreshing network info cache for port 0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG nova.network.neutron [req-a580d678-373b-4644-be47-e804d0cc46fb req-c28ba500-d84f-4759-8c0d-454977d23776 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updated VIF entry in instance network info cache for port 0ee4a18f-b92b-4bff-930f-0815d6962257. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG nova.network.neutron [req-a580d678-373b-4644-be47-e804d0cc46fb req-c28ba500-d84f-4759-8c0d-454977d23776 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updating instance_info_cache with network_info: [{"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a580d678-373b-4644-be47-e804d0cc46fb req-c28ba500-d84f-4759-8c0d-454977d23776 service nova] Releasing lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:41:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:31 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:41:31 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:41:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8503MB free_disk=25.233177185058594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 00:41:31 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 00:41:32 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:41:32 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:41:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:41:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG nova.objects.instance [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690504878.8181698, 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:41:33 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] VM Stopped (Lifecycle Event)
Jul 28 00:41:33 user nova-compute[70709]: DEBUG nova.compute.manager [None req-449b586b-a0cd-4eeb-96ac-1f69a3c9a766 None None] [instance: 0f2efeca-74ee-4d4b-a591-8cd8298d7ceb] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:33 user nova-compute[70709]: INFO nova.compute.manager [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attaching volume a95635fc-8959-4307-9f8e-a318b92ee38e to /dev/vdb
Jul 28 00:41:33 user nova-compute[70709]: DEBUG os_brick.utils [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5615e5e-b61e-4e3e-8571-d3857f301142]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f38fa16-ea18-4b8c-b9e8-c28a6205a841]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd714fd-56a7-434f-9508-d8e14c8d5240]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1bc81d-879b-4b3a-9a83-84e9b84f5d9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:41:34 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:41:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d05ae8-44c1-4ec6-bf31-baf5bcff5e36]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG os_brick.utils [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:41:34 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updating existing volume attachment record: b081b21e-f66d-4b4a-9624-7cdc97988ff1 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:41:35 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:41:35 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:41:35 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:41:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:41:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEecfClD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:41:40 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:41:40 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:41:40 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[039704a1-1873-4288-8c3e-f6aa47f64cdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:41:40 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c675cf-2686-4d1f-9bf3-47213cf21137]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e] added
Jul 28 00:41:40 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab9cae2-849b-49fa-bc1a-dfa65eacf0e3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce202a0-363e-4f91-ba28-c26aea08a98b]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SEecfClD {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SEecfClD" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c80d0f-09aa-4abe-8ba7-d138923a4efa]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SEecfClD'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[237f9838-a90a-491b-8352-36fe78a63d58]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35b7984-b077-4fc9-8aeb-98e15417a634]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 28 00:41:40 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 28 00:41:40 user nova-compute[70709]:  {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:41:40 user nova-compute[70709]: WARNING os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 28 00:41:40 user nova-compute[70709]: 
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a633799-d45c-4737-a665-b683156b112b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e, portal: 172.16.0.220,3260]
Jul 28 00:41:40 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e, portal: 172.16.0.220,3260] successful.
Jul 28 00:41:40 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa427e5-05e8-44bb-a5e2-6247fc9ed1b0]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a3d70-cda6-4fcc-a895-bf1cc96eb5c5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)
Jul 28 00:41:41 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)
Jul 28 00:41:41 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[394934c0-1d86-47c0-a8e3-42a1aab84743]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:41 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEecfClD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26566323138643430', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566323138643430', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG nova.objects.instance [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:41:42 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:41:42 user nova-compute[70709]:   <source dev="/dev/sdb"/>
Jul 28 00:41:42 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:41:42 user nova-compute[70709]:   <serial>a95635fc-8959-4307-9f8e-a318b92ee38e</serial>
Jul 28 00:41:42 user nova-compute[70709]: </disk>
Jul 28 00:41:42 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No VIF found with MAC fa:16:3e:01:51:d2, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-c7281ed0-f8c4-4d3e-9fca-32a606a4291c tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.742s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:41:42 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:41:43 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updating instance_info_cache with network_info: [{"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:41:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:41:43 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:41:43 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:41:43 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:41:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:41:47 user nova-compute[70709]: INFO nova.compute.claims [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Claim successful on node user
Jul 28 00:41:47 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:41:47 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:41:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG nova.policy [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd994eb215f204b029d183b73539e3d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d88e18679b4bc49c010b68ca813dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:41:47 user nova-compute[70709]: INFO nova.virt.block_device [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Booting with volume 72444c3c-4a7e-43bf-b6f7-961f5301eb1d at /dev/vda
Jul 28 00:41:47 user nova-compute[70709]: DEBUG os_brick.utils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[667e85c0-0b05-42db-a030-3de27ee1ec33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4061c6-9ef9-4c1a-902c-c3c11ff93e8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[02400acd-a750-4da8-86d5-d8e2b1c4179b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1129250-876c-49af-8486-b604f1abcd46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:41:48 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[522c5e6e-26f1-46dc-b275-ec89be6e35ad]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG os_brick.utils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Updating existing volume attachment record: b0fd849b-38f6-4421-88c9-e781703b81ba {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Successfully created port: f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:41:48 user nova-compute[70709]: INFO nova.compute.manager [None req-93e096bd-faa5-4ebd-a444-76a43e456ed3 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Unrescuing
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93e096bd-faa5-4ebd-a444-76a43e456ed3 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93e096bd-faa5-4ebd-a444-76a43e456ed3 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquired lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG nova.network.neutron [None req-93e096bd-faa5-4ebd-a444-76a43e456ed3 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:41:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG nova.network.neutron [None req-93e096bd-faa5-4ebd-a444-76a43e456ed3 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updating instance_info_cache with network_info: [{"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-93e096bd-faa5-4ebd-a444-76a43e456ed3 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Releasing lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG nova.objects.instance [None req-93e096bd-faa5-4ebd-a444-76a43e456ed3 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'flavor' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Successfully updated port: f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquired lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-4bbef9b8-0e71-4664-a36c-616fb3f56705 req-54161318-e84f-4417-9ed1-0fc7a36aec71 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received event network-changed-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-4bbef9b8-0e71-4664-a36c-616fb3f56705 req-54161318-e84f-4417-9ed1-0fc7a36aec71 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Refreshing instance network info cache due to event network-changed-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4bbef9b8-0e71-4664-a36c-616fb3f56705 req-54161318-e84f-4417-9ed1-0fc7a36aec71 service nova] Acquiring lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:49 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:41:49 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Instance destroyed successfully.
Jul 28 00:41:50 user nova-compute[70709]: DEBUG nova.network.neutron [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Updating instance_info_cache with network_info: [{"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:41:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Releasing lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:41:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Instance network_info: |[{"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:41:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4bbef9b8-0e71-4664-a36c-616fb3f56705 req-54161318-e84f-4417-9ed1-0fc7a36aec71 service nova] Acquired lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:41:50 user nova-compute[70709]: DEBUG nova.network.neutron [req-4bbef9b8-0e71-4664-a36c-616fb3f56705 req-54161318-e84f-4417-9ed1-0fc7a36aec71 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Refreshing network info cache for port f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:41:50 user nova-compute[70709]: DEBUG nova.network.neutron [req-4bbef9b8-0e71-4664-a36c-616fb3f56705 req-54161318-e84f-4417-9ed1-0fc7a36aec71 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Updated VIF entry in instance network info cache for port f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:41:50 user nova-compute[70709]: DEBUG nova.network.neutron [req-4bbef9b8-0e71-4664-a36c-616fb3f56705 req-54161318-e84f-4417-9ed1-0fc7a36aec71 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Updating instance_info_cache with network_info: [{"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:41:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4bbef9b8-0e71-4664-a36c-616fb3f56705 req-54161318-e84f-4417-9ed1-0fc7a36aec71 service nova] Releasing lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-unplugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-unplugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:41:51 user nova-compute[70709]: WARNING nova.compute.manager [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received unexpected event network-vif-unplugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:41:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:41:51 user nova-compute[70709]: WARNING nova.compute.manager [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received unexpected event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:41:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:51 user nova-compute[70709]: DEBUG nova.compute.manager [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:41:51 user nova-compute[70709]: WARNING nova.compute.manager [req-e5b9b292-9449-437f-90af-5fd655730ae1 req-ff695339-bf33-4a8b-9e75-586158120746 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received unexpected event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:41:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for 96099a70-86f0-4f81-877a-2f30c8c126f8 due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:41:53 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504913.3587077, 96099a70-86f0-4f81-877a-2f30c8c126f8 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:41:53 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] VM Resumed (Lifecycle Event)
Jul 28 00:41:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-93e096bd-faa5-4ebd-a444-76a43e456ed3 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:41:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:41:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:41:53 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 28 00:41:53 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504913.3608384, 96099a70-86f0-4f81-877a-2f30c8c126f8 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:41:53 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] VM Started (Lifecycle Event)
Jul 28 00:41:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:41:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:41:53 user nova-compute[70709]: DEBUG nova.compute.manager [req-99bd0c7a-858e-4bab-ae1b-4c07339111e4 req-ed82ff89-a3a0-4214-82a0-98e58215a6f8 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:41:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-99bd0c7a-858e-4bab-ae1b-4c07339111e4 req-ed82ff89-a3a0-4214-82a0-98e58215a6f8 service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-99bd0c7a-858e-4bab-ae1b-4c07339111e4 req-ed82ff89-a3a0-4214-82a0-98e58215a6f8 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-99bd0c7a-858e-4bab-ae1b-4c07339111e4 req-ed82ff89-a3a0-4214-82a0-98e58215a6f8 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:53 user nova-compute[70709]: DEBUG nova.compute.manager [req-99bd0c7a-858e-4bab-ae1b-4c07339111e4 req-ed82ff89-a3a0-4214-82a0-98e58215a6f8 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:41:53 user nova-compute[70709]: WARNING nova.compute.manager [req-99bd0c7a-858e-4bab-ae1b-4c07339111e4 req-ed82ff89-a3a0-4214-82a0-98e58215a6f8 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received unexpected event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with vm_state active and task_state None.
Jul 28 00:41:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:41:55 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Creating image(s)
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Ensure instance console log exists: /opt/stack/data/nova/instances/730e1d50-7320-4c5a-a57f-c5e7a2066a16/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Start _get_guest_xml network_info=[{"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b0fd849b-38f6-4421-88c9-e781703b81ba', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzKoQUxu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '730e1d50-7320-4c5a-a57f-c5e7a2066a16', 'attached_at': '', 'detached_at': '', 'volume_id': '72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 'serial': '72444c3c-4a7e-43bf-b6f7-961f5301eb1d'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:41:55 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:41:55 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzKoQUxu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:41:55 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:41:55 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:41:55 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba5777e-fea0-4882-b951-e6b260b7823b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:41:55 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7135a8e-a7d3-4510-8155-6ffc5393443d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d] added
Jul 28 00:41:55 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae15b656-3319-474b-8b26-da4762cb08cb]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02cb220-170f-4b6c-8395-a827b2922d50]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzKoQUxu {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzKoQUxu" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[114dddcc-4dde-4f35-9634-d19e008fbb38]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WzKoQUxu'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cf5285-b074-4e17-aa6d-c4063c2b63bd]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a813009-2ca2-47a9-a13e-5dfc99bed573]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)
Jul 28 00:41:55 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)
Jul 28 00:41:55 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bf7a5b-7443-4d36-a712-5a67b151e377]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260]
Jul 28 00:41:55 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260] successful.
Jul 28 00:41:55 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeb3e57-6906-49f7-b8e3-4a6b088902b0]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bbe500-9a92-48aa-9ab6-e3e3412d2970]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)
Jul 28 00:41:55 user nova-compute[70709]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:41:55 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)
Jul 28 00:41:55 user nova-compute[70709]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:41:55 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fc5b17-9bd0-4c3b-8ba2-ed9f62ca612e]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:41:55 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzKoQUxu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23134316530313432', 'path': '/dev/sdc'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134316530313432', 'path': '/dev/sdc'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-18726427',display_name='tempest-TestVolumeBootPattern-server-18726427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-18726427',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJASKlujGBh7q4FjBKCwUDBKdkAi9ZlmeDUwzkD1Smbvo/bJjZcXJHiVRyG3yLb9/84JrQ3NFZZ8DFC79UmemaYV3pBVbiAP8M5fiEEtqWcYd/Pk5XyfaCP8BM8JvkX0XQ==',key_name='tempest-TestVolumeBootPattern-248605266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-t3uy5gh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:41:48Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=730e1d50-7320-4c5a-a57f-c5e7a2066a16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:71:9e,bridge_name='br-int',has_traffic_filtering=True,id=f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15ef2c2-3c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG nova.objects.instance [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'pci_devices' on Instance uuid 730e1d50-7320-4c5a-a57f-c5e7a2066a16 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:41:56 user nova-compute[70709]:   <uuid>730e1d50-7320-4c5a-a57f-c5e7a2066a16</uuid>
Jul 28 00:41:56 user nova-compute[70709]:   <name>instance-0000002e</name>
Jul 28 00:41:56 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:41:56 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:41:56 user nova-compute[70709]:   <metadata>
Jul 28 00:41:56 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:41:56 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:41:56 user nova-compute[70709]:       <nova:name>tempest-TestVolumeBootPattern-server-18726427</nova:name>
Jul 28 00:41:56 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:41:55</nova:creationTime>
Jul 28 00:41:56 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:41:56 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:41:56 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:41:56 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:41:56 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:41:56 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:41:56 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:41:56 user nova-compute[70709]:       <nova:owner>
Jul 28 00:41:56 user nova-compute[70709]:         <nova:user uuid="d994eb215f204b029d183b73539e3d4d">tempest-TestVolumeBootPattern-2090046407-project-member</nova:user>
Jul 28 00:41:56 user nova-compute[70709]:         <nova:project uuid="47d88e18679b4bc49c010b68ca813dab">tempest-TestVolumeBootPattern-2090046407</nova:project>
Jul 28 00:41:56 user nova-compute[70709]:       </nova:owner>
Jul 28 00:41:56 user nova-compute[70709]:       <nova:ports>
Jul 28 00:41:56 user nova-compute[70709]:         <nova:port uuid="f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575">
Jul 28 00:41:56 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 28 00:41:56 user nova-compute[70709]:         </nova:port>
Jul 28 00:41:56 user nova-compute[70709]:       </nova:ports>
Jul 28 00:41:56 user nova-compute[70709]:     </nova:instance>
Jul 28 00:41:56 user nova-compute[70709]:   </metadata>
Jul 28 00:41:56 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:41:56 user nova-compute[70709]:     <system>
Jul 28 00:41:56 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:41:56 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:41:56 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:41:56 user nova-compute[70709]:       <entry name="serial">730e1d50-7320-4c5a-a57f-c5e7a2066a16</entry>
Jul 28 00:41:56 user nova-compute[70709]:       <entry name="uuid">730e1d50-7320-4c5a-a57f-c5e7a2066a16</entry>
Jul 28 00:41:56 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:41:56 user nova-compute[70709]:     </system>
Jul 28 00:41:56 user nova-compute[70709]:   </sysinfo>
Jul 28 00:41:56 user nova-compute[70709]:   <os>
Jul 28 00:41:56 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:41:56 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:41:56 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:41:56 user nova-compute[70709]:   </os>
Jul 28 00:41:56 user nova-compute[70709]:   <features>
Jul 28 00:41:56 user nova-compute[70709]:     <acpi/>
Jul 28 00:41:56 user nova-compute[70709]:     <apic/>
Jul 28 00:41:56 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:41:56 user nova-compute[70709]:   </features>
Jul 28 00:41:56 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:41:56 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:41:56 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:41:56 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:41:56 user nova-compute[70709]:   </clock>
Jul 28 00:41:56 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:41:56 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:41:56 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:41:56 user nova-compute[70709]:   </cpu>
Jul 28 00:41:56 user nova-compute[70709]:   <devices>
Jul 28 00:41:56 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:41:56 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:41:56 user nova-compute[70709]:       <source dev="/dev/sdc"/>
Jul 28 00:41:56 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:41:56 user nova-compute[70709]:       <serial>72444c3c-4a7e-43bf-b6f7-961f5301eb1d</serial>
Jul 28 00:41:56 user nova-compute[70709]:     </disk>
Jul 28 00:41:56 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:41:56 user nova-compute[70709]:       <mac address="fa:16:3e:22:71:9e"/>
Jul 28 00:41:56 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:41:56 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:41:56 user nova-compute[70709]:       <target dev="tapf15ef2c2-3c"/>
Jul 28 00:41:56 user nova-compute[70709]:     </interface>
Jul 28 00:41:56 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:41:56 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/730e1d50-7320-4c5a-a57f-c5e7a2066a16/console.log" append="off"/>
Jul 28 00:41:56 user nova-compute[70709]:     </serial>
Jul 28 00:41:56 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:41:56 user nova-compute[70709]:     <video>
Jul 28 00:41:56 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:41:56 user nova-compute[70709]:     </video>
Jul 28 00:41:56 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:41:56 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:41:56 user nova-compute[70709]:     </rng>
Jul 28 00:41:56 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:41:56 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:41:56 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:41:56 user nova-compute[70709]:     </memballoon>
Jul 28 00:41:56 user nova-compute[70709]:   </devices>
Jul 28 00:41:56 user nova-compute[70709]: </domain>
Jul 28 00:41:56 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-18726427',display_name='tempest-TestVolumeBootPattern-server-18726427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-18726427',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJASKlujGBh7q4FjBKCwUDBKdkAi9ZlmeDUwzkD1Smbvo/bJjZcXJHiVRyG3yLb9/84JrQ3NFZZ8DFC79UmemaYV3pBVbiAP8M5fiEEtqWcYd/Pk5XyfaCP8BM8JvkX0XQ==',key_name='tempest-TestVolumeBootPattern-248605266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-t3uy5gh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:41:48Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=730e1d50-7320-4c5a-a57f-c5e7a2066a16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:71:9e,bridge_name='br-int',has_traffic_filtering=True,id=f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15ef2c2-3c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG os_vif [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:71:9e,bridge_name='br-int',has_traffic_filtering=True,id=f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15ef2c2-3c') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf15ef2c2-3c, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf15ef2c2-3c, col_values=(('external_ids', {'iface-id': 'f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:71:9e', 'vm-uuid': '730e1d50-7320-4c5a-a57f-c5e7a2066a16'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:56 user nova-compute[70709]: INFO os_vif [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:71:9e,bridge_name='br-int',has_traffic_filtering=True,id=f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15ef2c2-3c')
Jul 28 00:41:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:41:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No VIF found with MAC fa:16:3e:22:71:9e, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:41:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-e1c46e52-8921-48cc-93b6-a523e2764fea req-8d2f9002-7d27-4e51-a0c3-353d7909bd6f service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received event network-vif-plugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:41:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e1c46e52-8921-48cc-93b6-a523e2764fea req-8d2f9002-7d27-4e51-a0c3-353d7909bd6f service nova] Acquiring lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:41:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e1c46e52-8921-48cc-93b6-a523e2764fea req-8d2f9002-7d27-4e51-a0c3-353d7909bd6f service nova] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:41:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e1c46e52-8921-48cc-93b6-a523e2764fea req-8d2f9002-7d27-4e51-a0c3-353d7909bd6f service nova] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:41:58 user nova-compute[70709]: DEBUG nova.compute.manager [req-e1c46e52-8921-48cc-93b6-a523e2764fea req-8d2f9002-7d27-4e51-a0c3-353d7909bd6f service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] No waiting events found dispatching network-vif-plugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:41:58 user nova-compute[70709]: WARNING nova.compute.manager [req-e1c46e52-8921-48cc-93b6-a523e2764fea req-8d2f9002-7d27-4e51-a0c3-353d7909bd6f service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received unexpected event network-vif-plugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 for instance with vm_state building and task_state spawning.
Jul 28 00:41:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:41:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504920.3271687, 730e1d50-7320-4c5a-a57f-c5e7a2066a16 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:42:00 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] VM Resumed (Lifecycle Event)
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:42:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Instance spawned successfully.
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:42:00 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690504920.3300736, 730e1d50-7320-4c5a-a57f-c5e7a2066a16 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:42:00 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] VM Started (Lifecycle Event)
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:42:00 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:42:00 user nova-compute[70709]: INFO nova.compute.manager [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Took 5.10 seconds to spawn the instance on the hypervisor.
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:42:00 user nova-compute[70709]: INFO nova.compute.manager [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Took 13.16 seconds to build instance.
Jul 28 00:42:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-e1374a90-c57e-4b7a-98fc-2447ef2dd89b tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.256s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-5ea215cc-329b-4824-a3cd-9517170a67bc req-d8056e5c-9fb5-4940-a0df-9fd7a1d68758 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received event network-vif-plugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5ea215cc-329b-4824-a3cd-9517170a67bc req-d8056e5c-9fb5-4940-a0df-9fd7a1d68758 service nova] Acquiring lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5ea215cc-329b-4824-a3cd-9517170a67bc req-d8056e5c-9fb5-4940-a0df-9fd7a1d68758 service nova] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5ea215cc-329b-4824-a3cd-9517170a67bc req-d8056e5c-9fb5-4940-a0df-9fd7a1d68758 service nova] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:42:00 user nova-compute[70709]: DEBUG nova.compute.manager [req-5ea215cc-329b-4824-a3cd-9517170a67bc req-d8056e5c-9fb5-4940-a0df-9fd7a1d68758 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] No waiting events found dispatching network-vif-plugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:42:00 user nova-compute[70709]: WARNING nova.compute.manager [req-5ea215cc-329b-4824-a3cd-9517170a67bc req-d8056e5c-9fb5-4940-a0df-9fd7a1d68758 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received unexpected event network-vif-plugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 for instance with vm_state active and task_state None.
Jul 28 00:42:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:42:02 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:42:02 user nova-compute[70709]: INFO nova.compute.manager [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Detaching volume a95635fc-8959-4307-9f8e-a318b92ee38e
Jul 28 00:42:03 user nova-compute[70709]: INFO nova.virt.block_device [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attempting to driver detach volume a95635fc-8959-4307-9f8e-a318b92ee38e from mountpoint /dev/vdb
Jul 28 00:42:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Attempting to detach device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:42:03 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:42:03 user nova-compute[70709]:   <source dev="/dev/sdb"/>
Jul 28 00:42:03 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:42:03 user nova-compute[70709]:   <serial>a95635fc-8959-4307-9f8e-a318b92ee38e</serial>
Jul 28 00:42:03 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:42:03 user nova-compute[70709]: </disk>
Jul 28 00:42:03 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:42:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Successfully detached device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the persistent domain config.
Jul 28 00:42:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:42:03 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:42:03 user nova-compute[70709]:   <source dev="/dev/sdb"/>
Jul 28 00:42:03 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:42:03 user nova-compute[70709]:   <serial>a95635fc-8959-4307-9f8e-a318b92ee38e</serial>
Jul 28 00:42:03 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:42:03 user nova-compute[70709]: </disk>
Jul 28 00:42:03 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504923.5995917, 4658dea2-f6e3-47db-8e37-97d64c70fe4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:42:03 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Successfully detached device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the live domain config.
Jul 28 00:42:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEecfClD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:42:03 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4576fa09-0171-4c14-accc-be5ca73e7adc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:42:03 user nova-compute[70709]: No targets found.
Jul 28 00:42:03 user nova-compute[70709]: iSNS:
Jul 28 00:42:03 user nova-compute[70709]: No targets found.
Jul 28 00:42:03 user nova-compute[70709]: STATIC:
Jul 28 00:42:03 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e
Jul 28 00:42:03 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:42:03 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:42:03 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d
Jul 28 00:42:03 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:42:03 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:42:03 user nova-compute[70709]: FIRMWARE:
Jul 28 00:42:03 user nova-compute[70709]: No targets found.
Jul 28 00:42:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:42:03 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:42:03 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[13937455-8518-4800-a34c-19089f017896]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3764b7e-8ced-4475-a35c-ea12e7185a3c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)
Jul 28 00:42:03 user nova-compute[70709]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:42:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e (non-flash)
Jul 28 00:42:03 user nova-compute[70709]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:42:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b886dbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e'): ({'sdb'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Removing single pathed devices sdb {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9638d49b-0e85-443e-82de-1d0678244e47]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31ccc2f-ef6b-4f70-8f61-00b95d2aa85c]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Flushing IO for device /dev/sdb {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[915fe08a-2adb-4ef9-a7f8-ab10c122bc6a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d93433-fb7a-4abb-9d4a-31831c814578]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4a9b15-2448-43e3-a77f-3d371922b28c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea61d58-99c3-4df3-aaff-a0cea9d08256]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e, portal: 172.16.0.220,3260]
Jul 28 00:42:03 user nova-compute[70709]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e, portal: 172.16.0.220,3260] successful.
Jul 28 00:42:03 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a95635fc-8959-4307-9f8e-a318b92ee38e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6748a3-33b0-4a87-84b6-e2b52a79c5d9]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== disconnect_volume: return (328ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:42:03 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:42:04 user nova-compute[70709]: DEBUG nova.objects.instance [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:42:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f16c8644-20c1-4f98-96d8-65d196312637 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:42:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:28 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:42:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:42:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:42:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:42:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:42:29 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:42:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:42:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:31 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:42:31 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:42:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8416MB free_disk=25.22942352294922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 730e1d50-7320-4c5a-a57f-c5e7a2066a16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:42:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:42:32 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:42:32 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:42:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:42:33 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:42:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:42:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:42:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:42:44 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:42:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:42:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:42:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:42:44 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:42:45 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updating instance_info_cache with network_info: [{"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:42:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:42:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:42:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:42:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:42:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:42:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:42:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:42:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:42:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG nova.objects.instance [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:42:58 user nova-compute[70709]: INFO nova.compute.manager [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attaching volume 4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 to /dev/vdb
Jul 28 00:42:58 user nova-compute[70709]: DEBUG os_brick.utils [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdede297-8561-40f4-b93e-a43969567249]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad373ab-1530-4520-8ce1-48d40c65aa49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecda6d2d-8a14-4820-bc56-c353dfc27476]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[37743957-9d04-42da-b25c-746f70e31173]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:42:58 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:42:58 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d3a8f5-d390-42e0-b1f3-731c86ef86a7]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG os_brick.utils [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:42:58 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updating existing volume attachment record: 236a5dfe-2b18-4300-a8d0-2a59c1068688 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:43:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKRukdNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:43:05 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:43:05 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:43:05 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a9ba94-7de8-4d9e-8626-5098a165daac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:43:05 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb4b237-85de-43c4-9371-bcfb3463f3b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314] added
Jul 28 00:43:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f473c249-4e95-449d-a5b9-047422490a95]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5cfeb6-313b-40ee-849f-9626e5ca1f29]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKRukdNa {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKRukdNa" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2ec3a6-e504-48fb-86de-2a963bde70b4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EKRukdNa'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[889916d9-b090-4926-a961-81bbf8203e21]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6416e8-4aba-4884-811c-65804eedd125]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:43:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:43:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5430ec8c-a6e8-4b57-b965-5b6dd3688683]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314, portal: 172.16.0.220,3260]
Jul 28 00:43:05 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314, portal: 172.16.0.220,3260] successful.
Jul 28 00:43:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bc8565-291b-4755-9608-340d0c063c56]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff547eb9-b781-417d-9460-fb264b86dc81]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:43:05 user nova-compute[70709]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 (non-flash)
Jul 28 00:43:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:43:05 user nova-compute[70709]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 (non-flash)
Jul 28 00:43:05 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa686ccb-ea04-4303-bcc2-a3455cb2f69e]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:05 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKRukdNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23531343632363433', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531343632363433', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG nova.objects.instance [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:43:06 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:43:06 user nova-compute[70709]:   <source dev="/dev/sdb"/>
Jul 28 00:43:06 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:43:06 user nova-compute[70709]:   <serial>4b5957bf-1e8e-4d1e-b7b3-50dea56d5314</serial>
Jul 28 00:43:06 user nova-compute[70709]: </disk>
Jul 28 00:43:06 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:43:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:43:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:43:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No VIF found with MAC fa:16:3e:01:51:d2, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:43:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee97c44a-6f39-4988-8472-7cdeef3090ab tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.796s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:09 user nova-compute[70709]: INFO nova.compute.manager [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Detaching volume 4b5957bf-1e8e-4d1e-b7b3-50dea56d5314
Jul 28 00:43:09 user nova-compute[70709]: INFO nova.virt.block_device [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attempting to driver detach volume 4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 from mountpoint /dev/vdb
Jul 28 00:43:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Attempting to detach device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:43:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:43:09 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:43:09 user nova-compute[70709]:   <source dev="/dev/sdb"/>
Jul 28 00:43:09 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:43:09 user nova-compute[70709]:   <serial>4b5957bf-1e8e-4d1e-b7b3-50dea56d5314</serial>
Jul 28 00:43:09 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:43:09 user nova-compute[70709]: </disk>
Jul 28 00:43:09 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:43:09 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Successfully detached device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the persistent domain config.
Jul 28 00:43:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:43:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:43:09 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:43:09 user nova-compute[70709]:   <source dev="/dev/sdb"/>
Jul 28 00:43:09 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:43:09 user nova-compute[70709]:   <serial>4b5957bf-1e8e-4d1e-b7b3-50dea56d5314</serial>
Jul 28 00:43:09 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:43:09 user nova-compute[70709]: </disk>
Jul 28 00:43:09 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:43:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690504989.9829328, 4658dea2-f6e3-47db-8e37-97d64c70fe4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:43:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:43:09 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Successfully detached device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the live domain config.
Jul 28 00:43:09 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:43:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKRukdNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:43:09 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:43:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:43:09 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:43:09 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c203d139-e42c-4629-b4c5-a3bc68496071]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:43:10 user nova-compute[70709]: No targets found.
Jul 28 00:43:10 user nova-compute[70709]: iSNS:
Jul 28 00:43:10 user nova-compute[70709]: No targets found.
Jul 28 00:43:10 user nova-compute[70709]: STATIC:
Jul 28 00:43:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314
Jul 28 00:43:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:43:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:43:10 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d
Jul 28 00:43:10 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:43:10 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:43:10 user nova-compute[70709]: FIRMWARE:
Jul 28 00:43:10 user nova-compute[70709]: No targets found.
Jul 28 00:43:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:43:10 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:43:10 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3173f65-f912-45b0-865e-75d40178ba47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[977eb783-ddf8-4a7e-baaf-601d8435a8db]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:43:10 user nova-compute[70709]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 (non-flash)
Jul 28 00:43:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:43:10 user nova-compute[70709]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 (non-flash)
Jul 28 00:43:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b90274ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314'): ({'sdb'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Removing single pathed devices sdb {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5191c4e-34dd-44c8-b7d4-9b5e38a29fa2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc816e9-5edb-44dc-b4e0-299dcfd900e7]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Flushing IO for device /dev/sdb {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5b2145-41bd-45b1-9ede-7db3c35adcc5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0866fe71-3ccc-4358-9c1b-4fffd0c1b614]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[029af245-cbd0-485b-b94a-12facec08a18]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --logout" returned: 0 in 0.163s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[29971628-0f5f-496a-9a12-afe15a38d78f]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314, portal: 172.16.0.220,3260]
Jul 28 00:43:10 user nova-compute[70709]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314, portal: 172.16.0.220,3260] successful.
Jul 28 00:43:10 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b5957bf-1e8e-4d1e-b7b3-50dea56d5314 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdea547-a977-4159-a6cc-e91c2d72cd84]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== disconnect_volume: return (391ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:43:10 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:43:11 user nova-compute[70709]: DEBUG nova.objects.instance [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:43:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-ee930718-4ffe-4e74-b6bc-ef1c4e98dde6 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.649s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:43:29 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:43:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:29 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:43:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:43:29 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:30 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:31 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:43:31 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:43:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8501MB free_disk=25.22838592529297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 730e1d50-7320-4c5a-a57f-c5e7a2066a16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:43:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:43:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:43:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:43:33 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:43:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:43:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:39 user nova-compute[70709]: DEBUG nova.compute.manager [req-f425f23b-a7d7-4707-8b09-9c7120c2f3a1 req-fa38e5c0-cdd1-4036-b0fb-0c34a3fa5f09 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received event network-changed-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:43:39 user nova-compute[70709]: DEBUG nova.compute.manager [req-f425f23b-a7d7-4707-8b09-9c7120c2f3a1 req-fa38e5c0-cdd1-4036-b0fb-0c34a3fa5f09 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Refreshing instance network info cache due to event network-changed-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:43:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f425f23b-a7d7-4707-8b09-9c7120c2f3a1 req-fa38e5c0-cdd1-4036-b0fb-0c34a3fa5f09 service nova] Acquiring lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:43:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f425f23b-a7d7-4707-8b09-9c7120c2f3a1 req-fa38e5c0-cdd1-4036-b0fb-0c34a3fa5f09 service nova] Acquired lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:43:39 user nova-compute[70709]: DEBUG nova.network.neutron [req-f425f23b-a7d7-4707-8b09-9c7120c2f3a1 req-fa38e5c0-cdd1-4036-b0fb-0c34a3fa5f09 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Refreshing network info cache for port f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:43:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:43:40 user nova-compute[70709]: DEBUG nova.network.neutron [req-f425f23b-a7d7-4707-8b09-9c7120c2f3a1 req-fa38e5c0-cdd1-4036-b0fb-0c34a3fa5f09 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Updated VIF entry in instance network info cache for port f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:43:40 user nova-compute[70709]: DEBUG nova.network.neutron [req-f425f23b-a7d7-4707-8b09-9c7120c2f3a1 req-fa38e5c0-cdd1-4036-b0fb-0c34a3fa5f09 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Updating instance_info_cache with network_info: [{"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:43:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f425f23b-a7d7-4707-8b09-9c7120c2f3a1 req-fa38e5c0-cdd1-4036-b0fb-0c34a3fa5f09 service nova] Releasing lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:43:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:43 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:43:44 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:43:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:43:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:43:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:43:44 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updating instance_info_cache with network_info: [{"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:43:45 user nova-compute[70709]: INFO nova.compute.claims [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Claim successful on node user
Jul 28 00:43:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG nova.network.neutron [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:43:46 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:43:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG nova.policy [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8afed76354148e290f0b4f602616818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad38eeba09ce4551899f892ea787ea1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:43:46 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Creating image(s)
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "/opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk 1073741824" returned: 0 in 0.058s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Cannot resize image /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG nova.objects.instance [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'migration_context' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Ensure instance console log exists: /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:47 user nova-compute[70709]: DEBUG nova.network.neutron [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Successfully created port: 0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:43:47 user nova-compute[70709]: DEBUG nova.network.neutron [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Successfully updated port: 0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:43:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:43:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquired lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:43:47 user nova-compute[70709]: DEBUG nova.network.neutron [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:43:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-d0b2ea65-84e4-4f17-92eb-a7ea65a7dcc5 req-4d277378-7f67-4eb0-a54c-f1ffc6afcea2 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-changed-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:43:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-d0b2ea65-84e4-4f17-92eb-a7ea65a7dcc5 req-4d277378-7f67-4eb0-a54c-f1ffc6afcea2 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Refreshing instance network info cache due to event network-changed-0ca782ea-ee7e-4a72-8830-8aa6194b072c. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:43:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d0b2ea65-84e4-4f17-92eb-a7ea65a7dcc5 req-4d277378-7f67-4eb0-a54c-f1ffc6afcea2 service nova] Acquiring lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:43:47 user nova-compute[70709]: DEBUG nova.network.neutron [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.network.neutron [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updating instance_info_cache with network_info: [{"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Releasing lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Instance network_info: |[{"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d0b2ea65-84e4-4f17-92eb-a7ea65a7dcc5 req-4d277378-7f67-4eb0-a54c-f1ffc6afcea2 service nova] Acquired lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.network.neutron [req-d0b2ea65-84e4-4f17-92eb-a7ea65a7dcc5 req-4d277378-7f67-4eb0-a54c-f1ffc6afcea2 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Refreshing network info cache for port 0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Start _get_guest_xml network_info=[{"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:48 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:43:48 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2129512621',display_name='tempest-ServerRescueNegativeTestJSON-server-2129512621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2129512621',id=47,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIkjUZ8Ct3mkPHoB8VEfjyVbahhtK6LD1UExufiyJWkyxpLp3IwdHejllwZCdIwOmmIqSZgxaTPuNXf8aWJu+qgQFjbX6HpxP3hRRLTjKq+Pqfkh4kCGjRFHm0qQCv1pg==',key_name='tempest-keypair-2132315906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-xdxw3fk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8afed76354148e290f0b4f602616818',uuid=d76e49c9-7dc6-444f-a347-2ab782f56144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=0ca782ea-ee7e-4a72-8830-8aa6194b072c,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca782ea-ee') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.objects.instance [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'pci_devices' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:43:48 user nova-compute[70709]:   <uuid>d76e49c9-7dc6-444f-a347-2ab782f56144</uuid>
Jul 28 00:43:48 user nova-compute[70709]:   <name>instance-0000002f</name>
Jul 28 00:43:48 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:43:48 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:43:48 user nova-compute[70709]:   <metadata>
Jul 28 00:43:48 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:43:48 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:43:48 user nova-compute[70709]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2129512621</nova:name>
Jul 28 00:43:48 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:43:48</nova:creationTime>
Jul 28 00:43:48 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:43:48 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:43:48 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:43:48 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:43:48 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:43:48 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:43:48 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:43:48 user nova-compute[70709]:       <nova:owner>
Jul 28 00:43:48 user nova-compute[70709]:         <nova:user uuid="d8afed76354148e290f0b4f602616818">tempest-ServerRescueNegativeTestJSON-1040689578-project-member</nova:user>
Jul 28 00:43:48 user nova-compute[70709]:         <nova:project uuid="ad38eeba09ce4551899f892ea787ea1c">tempest-ServerRescueNegativeTestJSON-1040689578</nova:project>
Jul 28 00:43:48 user nova-compute[70709]:       </nova:owner>
Jul 28 00:43:48 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:43:48 user nova-compute[70709]:       <nova:ports>
Jul 28 00:43:48 user nova-compute[70709]:         <nova:port uuid="0ca782ea-ee7e-4a72-8830-8aa6194b072c">
Jul 28 00:43:48 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 28 00:43:48 user nova-compute[70709]:         </nova:port>
Jul 28 00:43:48 user nova-compute[70709]:       </nova:ports>
Jul 28 00:43:48 user nova-compute[70709]:     </nova:instance>
Jul 28 00:43:48 user nova-compute[70709]:   </metadata>
Jul 28 00:43:48 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:43:48 user nova-compute[70709]:     <system>
Jul 28 00:43:48 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:43:48 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:43:48 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:43:48 user nova-compute[70709]:       <entry name="serial">d76e49c9-7dc6-444f-a347-2ab782f56144</entry>
Jul 28 00:43:48 user nova-compute[70709]:       <entry name="uuid">d76e49c9-7dc6-444f-a347-2ab782f56144</entry>
Jul 28 00:43:48 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:43:48 user nova-compute[70709]:     </system>
Jul 28 00:43:48 user nova-compute[70709]:   </sysinfo>
Jul 28 00:43:48 user nova-compute[70709]:   <os>
Jul 28 00:43:48 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:43:48 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:43:48 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:43:48 user nova-compute[70709]:   </os>
Jul 28 00:43:48 user nova-compute[70709]:   <features>
Jul 28 00:43:48 user nova-compute[70709]:     <acpi/>
Jul 28 00:43:48 user nova-compute[70709]:     <apic/>
Jul 28 00:43:48 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:43:48 user nova-compute[70709]:   </features>
Jul 28 00:43:48 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:43:48 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:43:48 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:43:48 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:43:48 user nova-compute[70709]:   </clock>
Jul 28 00:43:48 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:43:48 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:43:48 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:43:48 user nova-compute[70709]:   </cpu>
Jul 28 00:43:48 user nova-compute[70709]:   <devices>
Jul 28 00:43:48 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:43:48 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:43:48 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk"/>
Jul 28 00:43:48 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:43:48 user nova-compute[70709]:     </disk>
Jul 28 00:43:48 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:43:48 user nova-compute[70709]:       <mac address="fa:16:3e:75:a1:0a"/>
Jul 28 00:43:48 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:43:48 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:43:48 user nova-compute[70709]:       <target dev="tap0ca782ea-ee"/>
Jul 28 00:43:48 user nova-compute[70709]:     </interface>
Jul 28 00:43:48 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:43:48 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/console.log" append="off"/>
Jul 28 00:43:48 user nova-compute[70709]:     </serial>
Jul 28 00:43:48 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:43:48 user nova-compute[70709]:     <video>
Jul 28 00:43:48 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:43:48 user nova-compute[70709]:     </video>
Jul 28 00:43:48 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:43:48 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:43:48 user nova-compute[70709]:     </rng>
Jul 28 00:43:48 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:43:48 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:43:48 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:43:48 user nova-compute[70709]:     </memballoon>
Jul 28 00:43:48 user nova-compute[70709]:   </devices>
Jul 28 00:43:48 user nova-compute[70709]: </domain>
Jul 28 00:43:48 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2129512621',display_name='tempest-ServerRescueNegativeTestJSON-server-2129512621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2129512621',id=47,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIkjUZ8Ct3mkPHoB8VEfjyVbahhtK6LD1UExufiyJWkyxpLp3IwdHejllwZCdIwOmmIqSZgxaTPuNXf8aWJu+qgQFjbX6HpxP3hRRLTjKq+Pqfkh4kCGjRFHm0qQCv1pg==',key_name='tempest-keypair-2132315906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-xdxw3fk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8afed76354148e290f0b4f602616818',uuid=d76e49c9-7dc6-444f-a347-2ab782f56144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=0ca782ea-ee7e-4a72-8830-8aa6194b072c,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca782ea-ee') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG os_vif [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=0ca782ea-ee7e-4a72-8830-8aa6194b072c,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca782ea-ee') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ca782ea-ee, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ca782ea-ee, col_values=(('external_ids', {'iface-id': '0ca782ea-ee7e-4a72-8830-8aa6194b072c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:a1:0a', 'vm-uuid': 'd76e49c9-7dc6-444f-a347-2ab782f56144'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:48 user nova-compute[70709]: INFO os_vif [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=0ca782ea-ee7e-4a72-8830-8aa6194b072c,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca782ea-ee')
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No VIF found with MAC fa:16:3e:75:a1:0a, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.network.neutron [req-d0b2ea65-84e4-4f17-92eb-a7ea65a7dcc5 req-4d277378-7f67-4eb0-a54c-f1ffc6afcea2 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updated VIF entry in instance network info cache for port 0ca782ea-ee7e-4a72-8830-8aa6194b072c. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG nova.network.neutron [req-d0b2ea65-84e4-4f17-92eb-a7ea65a7dcc5 req-4d277378-7f67-4eb0-a54c-f1ffc6afcea2 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updating instance_info_cache with network_info: [{"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:43:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d0b2ea65-84e4-4f17-92eb-a7ea65a7dcc5 req-4d277378-7f67-4eb0-a54c-f1ffc6afcea2 service nova] Releasing lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:43:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-b05f5267-5644-4222-8226-315a0e14d6f6 req-7a71d4d0-448d-4e69-9647-7ddaad9b231f service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:43:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b05f5267-5644-4222-8226-315a0e14d6f6 req-7a71d4d0-448d-4e69-9647-7ddaad9b231f service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b05f5267-5644-4222-8226-315a0e14d6f6 req-7a71d4d0-448d-4e69-9647-7ddaad9b231f service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b05f5267-5644-4222-8226-315a0e14d6f6 req-7a71d4d0-448d-4e69-9647-7ddaad9b231f service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-b05f5267-5644-4222-8226-315a0e14d6f6 req-7a71d4d0-448d-4e69-9647-7ddaad9b231f service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:43:50 user nova-compute[70709]: WARNING nova.compute.manager [req-b05f5267-5644-4222-8226-315a0e14d6f6 req-7a71d4d0-448d-4e69-9647-7ddaad9b231f service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received unexpected event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with vm_state building and task_state spawning.
Jul 28 00:43:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505032.048967, d76e49c9-7dc6-444f-a347-2ab782f56144 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:43:52 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] VM Resumed (Lifecycle Event)
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:43:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Instance spawned successfully.
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-be1853f9-8fdd-45cf-ad27-f2777be634cf req-92cb6e10-6800-47ef-80f9-08cc83fa112e service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be1853f9-8fdd-45cf-ad27-f2777be634cf req-92cb6e10-6800-47ef-80f9-08cc83fa112e service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be1853f9-8fdd-45cf-ad27-f2777be634cf req-92cb6e10-6800-47ef-80f9-08cc83fa112e service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-be1853f9-8fdd-45cf-ad27-f2777be634cf req-92cb6e10-6800-47ef-80f9-08cc83fa112e service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-be1853f9-8fdd-45cf-ad27-f2777be634cf req-92cb6e10-6800-47ef-80f9-08cc83fa112e service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:43:52 user nova-compute[70709]: WARNING nova.compute.manager [req-be1853f9-8fdd-45cf-ad27-f2777be634cf req-92cb6e10-6800-47ef-80f9-08cc83fa112e service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received unexpected event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with vm_state building and task_state spawning.
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:43:52 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505032.050426, d76e49c9-7dc6-444f-a347-2ab782f56144 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:43:52 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] VM Started (Lifecycle Event)
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:43:52 user nova-compute[70709]: INFO nova.compute.manager [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Took 5.97 seconds to spawn the instance on the hypervisor.
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:43:52 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:43:52 user nova-compute[70709]: INFO nova.compute.manager [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Took 6.60 seconds to build instance.
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "09eee7ad-3463-46f6-8348-b68cb1b20a11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-06e90f20-4956-47e3-ac48-e4afb3c4e607 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.713s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:43:52 user nova-compute[70709]: INFO nova.compute.claims [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Claim successful on node user
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.network.neutron [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:43:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG nova.policy [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd994eb215f204b029d183b73539e3d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d88e18679b4bc49c010b68ca813dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:43:52 user nova-compute[70709]: INFO nova.virt.block_device [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Booting with volume 21b60881-e898-41d7-ba14-4296f13692fb at /dev/vda
Jul 28 00:43:52 user nova-compute[70709]: DEBUG os_brick.utils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d09b10-29b2-4d0a-ab18-cf3ca6e62856]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc420677-d544-45a1-a2db-1eb3b0b27e59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7619cc17-f337-4de4-927a-44622e6c6a80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8052efc8-3c04-4736-b0ab-438d4d98593e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:43:53 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:43:53 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e664e1b0-98ca-4a54-99e4-1712bb1d1ca0]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG os_brick.utils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Updating existing volume attachment record: 0e6f79ac-cc20-4889-bcd4-8976c1c562ae {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:53 user nova-compute[70709]: DEBUG nova.network.neutron [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Successfully created port: 129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG nova.network.neutron [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Successfully updated port: 129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquired lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG nova.network.neutron [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-66ec7053-912d-477f-84b1-62a39df93d2b req-39448705-49c4-45f4-8a20-6c68fe143163 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received event network-changed-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-66ec7053-912d-477f-84b1-62a39df93d2b req-39448705-49c4-45f4-8a20-6c68fe143163 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Refreshing instance network info cache due to event network-changed-129da7ca-f400-4977-8eaf-daa2868e20fd. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-66ec7053-912d-477f-84b1-62a39df93d2b req-39448705-49c4-45f4-8a20-6c68fe143163 service nova] Acquiring lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG nova.network.neutron [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG nova.network.neutron [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Updating instance_info_cache with network_info: [{"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Releasing lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Instance network_info: |[{"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-66ec7053-912d-477f-84b1-62a39df93d2b req-39448705-49c4-45f4-8a20-6c68fe143163 service nova] Acquired lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:43:54 user nova-compute[70709]: DEBUG nova.network.neutron [req-66ec7053-912d-477f-84b1-62a39df93d2b req-39448705-49c4-45f4-8a20-6c68fe143163 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Refreshing network info cache for port 129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:43:55 user nova-compute[70709]: DEBUG nova.network.neutron [req-66ec7053-912d-477f-84b1-62a39df93d2b req-39448705-49c4-45f4-8a20-6c68fe143163 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Updated VIF entry in instance network info cache for port 129da7ca-f400-4977-8eaf-daa2868e20fd. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:43:55 user nova-compute[70709]: DEBUG nova.network.neutron [req-66ec7053-912d-477f-84b1-62a39df93d2b req-39448705-49c4-45f4-8a20-6c68fe143163 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Updating instance_info_cache with network_info: [{"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:43:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-66ec7053-912d-477f-84b1-62a39df93d2b req-39448705-49c4-45f4-8a20-6c68fe143163 service nova] Releasing lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:43:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:43:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:44:00 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Creating image(s)
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Ensure instance console log exists: /opt/stack/data/nova/instances/09eee7ad-3463-46f6-8348-b68cb1b20a11/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Start _get_guest_xml network_info=[{"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '0e6f79ac-cc20-4889-bcd4-8976c1c562ae', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcFRJOMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '09eee7ad-3463-46f6-8348-b68cb1b20a11', 'attached_at': '', 'detached_at': '', 'volume_id': '21b60881-e898-41d7-ba14-4296f13692fb', 'serial': '21b60881-e898-41d7-ba14-4296f13692fb'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:44:00 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:44:00 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcFRJOMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:44:00 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:44:00 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:44:00 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f789d0-42e7-4bcc-9fb0-78d7f2380887]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:44:00 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[410a343a-f339-4ec9-9a6b-8b8455796ea1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb] added
Jul 28 00:44:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fd130d-389d-4648-a509-20246fade1e5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d19bfd-2c4d-4934-8290-d461b63e05db]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcFRJOMl {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcFRJOMl" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9483af3-91d5-431f-9b39-75cd4addc75e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcFRJOMl'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[820c312a-c97a-4a46-91f5-18d6b8d29697]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beca2a3-6ffd-4467-b95e-9ce6d94b885b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:44:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:44:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5a1f85-0579-42da-b73e-ff22714a6861]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb, portal: 172.16.0.220,3260]
Jul 28 00:44:00 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb, portal: 172.16.0.220,3260] successful.
Jul 28 00:44:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dac588c-9541-44c9-9c10-2cdaeeeb9934]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a4ef85-18ea-4c15-8bc1-c168b803682f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:44:00 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:44:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:44:00 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:44:00 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fa4e03-fcd5-4004-b446-98bfffab6bcd]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:00 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcFRJOMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26362653633626562', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362653633626562', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1680581561',display_name='tempest-TestVolumeBootPattern-server-1680581561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1680581561',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJASKlujGBh7q4FjBKCwUDBKdkAi9ZlmeDUwzkD1Smbvo/bJjZcXJHiVRyG3yLb9/84JrQ3NFZZ8DFC79UmemaYV3pBVbiAP8M5fiEEtqWcYd/Pk5XyfaCP8BM8JvkX0XQ==',key_name='tempest-TestVolumeBootPattern-248605266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-9gazj65m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:43:53Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=09eee7ad-3463-46f6-8348-b68cb1b20a11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:af:48,bridge_name='br-int',has_traffic_filtering=True,id=129da7ca-f400-4977-8eaf-daa2868e20fd,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129da7ca-f4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG nova.objects.instance [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'pci_devices' on Instance uuid 09eee7ad-3463-46f6-8348-b68cb1b20a11 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:44:01 user nova-compute[70709]:   <uuid>09eee7ad-3463-46f6-8348-b68cb1b20a11</uuid>
Jul 28 00:44:01 user nova-compute[70709]:   <name>instance-00000030</name>
Jul 28 00:44:01 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:44:01 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:44:01 user nova-compute[70709]:   <metadata>
Jul 28 00:44:01 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:44:01 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:44:01 user nova-compute[70709]:       <nova:name>tempest-TestVolumeBootPattern-server-1680581561</nova:name>
Jul 28 00:44:01 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:44:00</nova:creationTime>
Jul 28 00:44:01 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:44:01 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:44:01 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:44:01 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:44:01 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:44:01 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:44:01 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:44:01 user nova-compute[70709]:       <nova:owner>
Jul 28 00:44:01 user nova-compute[70709]:         <nova:user uuid="d994eb215f204b029d183b73539e3d4d">tempest-TestVolumeBootPattern-2090046407-project-member</nova:user>
Jul 28 00:44:01 user nova-compute[70709]:         <nova:project uuid="47d88e18679b4bc49c010b68ca813dab">tempest-TestVolumeBootPattern-2090046407</nova:project>
Jul 28 00:44:01 user nova-compute[70709]:       </nova:owner>
Jul 28 00:44:01 user nova-compute[70709]:       <nova:ports>
Jul 28 00:44:01 user nova-compute[70709]:         <nova:port uuid="129da7ca-f400-4977-8eaf-daa2868e20fd">
Jul 28 00:44:01 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 28 00:44:01 user nova-compute[70709]:         </nova:port>
Jul 28 00:44:01 user nova-compute[70709]:       </nova:ports>
Jul 28 00:44:01 user nova-compute[70709]:     </nova:instance>
Jul 28 00:44:01 user nova-compute[70709]:   </metadata>
Jul 28 00:44:01 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:44:01 user nova-compute[70709]:     <system>
Jul 28 00:44:01 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:44:01 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:44:01 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:44:01 user nova-compute[70709]:       <entry name="serial">09eee7ad-3463-46f6-8348-b68cb1b20a11</entry>
Jul 28 00:44:01 user nova-compute[70709]:       <entry name="uuid">09eee7ad-3463-46f6-8348-b68cb1b20a11</entry>
Jul 28 00:44:01 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:44:01 user nova-compute[70709]:     </system>
Jul 28 00:44:01 user nova-compute[70709]:   </sysinfo>
Jul 28 00:44:01 user nova-compute[70709]:   <os>
Jul 28 00:44:01 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:44:01 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:44:01 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:44:01 user nova-compute[70709]:   </os>
Jul 28 00:44:01 user nova-compute[70709]:   <features>
Jul 28 00:44:01 user nova-compute[70709]:     <acpi/>
Jul 28 00:44:01 user nova-compute[70709]:     <apic/>
Jul 28 00:44:01 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:44:01 user nova-compute[70709]:   </features>
Jul 28 00:44:01 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:44:01 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:44:01 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:44:01 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:44:01 user nova-compute[70709]:   </clock>
Jul 28 00:44:01 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:44:01 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:44:01 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:44:01 user nova-compute[70709]:   </cpu>
Jul 28 00:44:01 user nova-compute[70709]:   <devices>
Jul 28 00:44:01 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:44:01 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:44:01 user nova-compute[70709]:       <source dev="/dev/sdb"/>
Jul 28 00:44:01 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:44:01 user nova-compute[70709]:       <serial>21b60881-e898-41d7-ba14-4296f13692fb</serial>
Jul 28 00:44:01 user nova-compute[70709]:     </disk>
Jul 28 00:44:01 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:44:01 user nova-compute[70709]:       <mac address="fa:16:3e:e4:af:48"/>
Jul 28 00:44:01 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:44:01 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:44:01 user nova-compute[70709]:       <target dev="tap129da7ca-f4"/>
Jul 28 00:44:01 user nova-compute[70709]:     </interface>
Jul 28 00:44:01 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:44:01 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/09eee7ad-3463-46f6-8348-b68cb1b20a11/console.log" append="off"/>
Jul 28 00:44:01 user nova-compute[70709]:     </serial>
Jul 28 00:44:01 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:44:01 user nova-compute[70709]:     <video>
Jul 28 00:44:01 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:44:01 user nova-compute[70709]:     </video>
Jul 28 00:44:01 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:44:01 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:44:01 user nova-compute[70709]:     </rng>
Jul 28 00:44:01 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:44:01 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:44:01 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:44:01 user nova-compute[70709]:     </memballoon>
Jul 28 00:44:01 user nova-compute[70709]:   </devices>
Jul 28 00:44:01 user nova-compute[70709]: </domain>
Jul 28 00:44:01 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1680581561',display_name='tempest-TestVolumeBootPattern-server-1680581561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1680581561',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJASKlujGBh7q4FjBKCwUDBKdkAi9ZlmeDUwzkD1Smbvo/bJjZcXJHiVRyG3yLb9/84JrQ3NFZZ8DFC79UmemaYV3pBVbiAP8M5fiEEtqWcYd/Pk5XyfaCP8BM8JvkX0XQ==',key_name='tempest-TestVolumeBootPattern-248605266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-9gazj65m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:43:53Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=09eee7ad-3463-46f6-8348-b68cb1b20a11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:af:48,bridge_name='br-int',has_traffic_filtering=True,id=129da7ca-f400-4977-8eaf-daa2868e20fd,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129da7ca-f4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG os_vif [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:af:48,bridge_name='br-int',has_traffic_filtering=True,id=129da7ca-f400-4977-8eaf-daa2868e20fd,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129da7ca-f4') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap129da7ca-f4, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap129da7ca-f4, col_values=(('external_ids', {'iface-id': '129da7ca-f400-4977-8eaf-daa2868e20fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:af:48', 'vm-uuid': '09eee7ad-3463-46f6-8348-b68cb1b20a11'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:01 user nova-compute[70709]: INFO os_vif [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:af:48,bridge_name='br-int',has_traffic_filtering=True,id=129da7ca-f400-4977-8eaf-daa2868e20fd,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129da7ca-f4')
Jul 28 00:44:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:44:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] No VIF found with MAC fa:16:3e:e4:af:48, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:44:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-d9d85492-986f-40a9-abe1-ae5a1c7c588f req-fdc736b9-73bc-4c57-9c8e-9c61b19cd663 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received event network-vif-plugged-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:44:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d9d85492-986f-40a9-abe1-ae5a1c7c588f req-fdc736b9-73bc-4c57-9c8e-9c61b19cd663 service nova] Acquiring lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:44:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d9d85492-986f-40a9-abe1-ae5a1c7c588f req-fdc736b9-73bc-4c57-9c8e-9c61b19cd663 service nova] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:44:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d9d85492-986f-40a9-abe1-ae5a1c7c588f req-fdc736b9-73bc-4c57-9c8e-9c61b19cd663 service nova] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:44:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-d9d85492-986f-40a9-abe1-ae5a1c7c588f req-fdc736b9-73bc-4c57-9c8e-9c61b19cd663 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] No waiting events found dispatching network-vif-plugged-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:44:03 user nova-compute[70709]: WARNING nova.compute.manager [req-d9d85492-986f-40a9-abe1-ae5a1c7c588f req-fdc736b9-73bc-4c57-9c8e-9c61b19cd663 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received unexpected event network-vif-plugged-129da7ca-f400-4977-8eaf-daa2868e20fd for instance with vm_state building and task_state spawning.
Jul 28 00:44:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505045.525576, 09eee7ad-3463-46f6-8348-b68cb1b20a11 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:44:05 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] VM Resumed (Lifecycle Event)
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:44:05 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Instance spawned successfully.
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-f80c1c21-47bd-4398-b1e7-7d7216fdf17c req-2034d7af-b3f9-4257-b797-445559f865ef service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received event network-vif-plugged-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f80c1c21-47bd-4398-b1e7-7d7216fdf17c req-2034d7af-b3f9-4257-b797-445559f865ef service nova] Acquiring lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f80c1c21-47bd-4398-b1e7-7d7216fdf17c req-2034d7af-b3f9-4257-b797-445559f865ef service nova] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f80c1c21-47bd-4398-b1e7-7d7216fdf17c req-2034d7af-b3f9-4257-b797-445559f865ef service nova] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-f80c1c21-47bd-4398-b1e7-7d7216fdf17c req-2034d7af-b3f9-4257-b797-445559f865ef service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] No waiting events found dispatching network-vif-plugged-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:44:05 user nova-compute[70709]: WARNING nova.compute.manager [req-f80c1c21-47bd-4398-b1e7-7d7216fdf17c req-2034d7af-b3f9-4257-b797-445559f865ef service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received unexpected event network-vif-plugged-129da7ca-f400-4977-8eaf-daa2868e20fd for instance with vm_state building and task_state spawning.
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:44:05 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505045.5293822, 09eee7ad-3463-46f6-8348-b68cb1b20a11 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:44:05 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] VM Started (Lifecycle Event)
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:44:05 user nova-compute[70709]: INFO nova.compute.manager [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Took 5.17 seconds to spawn the instance on the hypervisor.
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:44:05 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:44:05 user nova-compute[70709]: INFO nova.compute.manager [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Took 13.35 seconds to build instance.
Jul 28 00:44:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d979774c-1734-4b4a-89df-c81fbb625ad7 tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.462s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:44:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:44:06 user nova-compute[70709]: INFO nova.compute.manager [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attaching volume 73d6cf4a-c26f-4a6c-8803-33bb344c7412 to /dev/vdb
Jul 28 00:44:06 user nova-compute[70709]: DEBUG os_brick.utils [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3814fd-b295-4859-a699-4577bc81de75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac764f05-d171-404a-847c-75c0745cf055]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d711e536-3058-4ad1-a314-8e2dd7ddd283]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10c22a6-6d9e-40a1-a561-1dab6d34fefc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:44:06 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:44:06 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d810f92-a80c-4604-8f97-edaa22bf8c63]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG os_brick.utils [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updating existing volume attachment record: 39f51eef-2cf5-4b3a-b603-df271f1897fd {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:44:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZGzLgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:44:13 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:44:13 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:44:13 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[852d4f7c-d125-4733-9c5c-4b0c72a2967a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:44:13 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df39f44-8736-4604-b925-2ad17aa012da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412] added
Jul 28 00:44:13 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8059ec1b-9e0f-4bb9-99f9-fbcd6bb99d9e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf79271-3355-41cc-98da-c94da26e4952]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcZGzLgn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcZGzLgn" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1de0226-73b2-4491-83c2-70bc9d32e688]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcZGzLgn'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bed93b-d7db-4cbc-bef7-dabd48b97dff]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf22e54a-6695-46e7-85b4-5d4bc0b7a3f4]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:44:13 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:44:13 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:44:13 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:44:13 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d980b74-03ff-4389-b92d-56fdd384999f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412, portal: 172.16.0.220,3260]
Jul 28 00:44:13 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412, portal: 172.16.0.220,3260] successful.
Jul 28 00:44:13 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebfb6fe-16a2-4a98-b6f6-b309b26c4a69]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4bef15-336c-4ac2-9c8a-a34e161ee259]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:44:13 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:44:13 user nova-compute[70709]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 (non-flash)
Jul 28 00:44:13 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:44:13 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:44:13 user nova-compute[70709]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 (non-flash)
Jul 28 00:44:13 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c772213-556b-412e-a58d-ffea7e124fc5]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:13 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:44:14 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:44:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZGzLgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:44:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:44:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23564613235626530', 'path': '/dev/sdd'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:44:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564613235626530', 'path': '/dev/sdd'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:44:14 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:44:14 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:44:14 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:44:14 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:44:14 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:44:14 user nova-compute[70709]:   <serial>73d6cf4a-c26f-4a6c-8803-33bb344c7412</serial>
Jul 28 00:44:14 user nova-compute[70709]: </disk>
Jul 28 00:44:14 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:44:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:44:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:44:15 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No VIF found with MAC fa:16:3e:01:51:d2, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:44:15 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9c5678d2-5086-4e08-a961-aeba41e3abcf tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.368s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:44:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:44:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:44:17 user nova-compute[70709]: INFO nova.compute.manager [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Detaching volume 73d6cf4a-c26f-4a6c-8803-33bb344c7412
Jul 28 00:44:17 user nova-compute[70709]: INFO nova.virt.block_device [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attempting to driver detach volume 73d6cf4a-c26f-4a6c-8803-33bb344c7412 from mountpoint /dev/vdb
Jul 28 00:44:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Attempting to detach device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:44:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:44:17 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:44:17 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:44:17 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:44:17 user nova-compute[70709]:   <serial>73d6cf4a-c26f-4a6c-8803-33bb344c7412</serial>
Jul 28 00:44:17 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:44:17 user nova-compute[70709]: </disk>
Jul 28 00:44:17 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:44:17 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Successfully detached device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the persistent domain config.
Jul 28 00:44:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:44:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:44:17 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:44:17 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:44:17 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:44:17 user nova-compute[70709]:   <serial>73d6cf4a-c26f-4a6c-8803-33bb344c7412</serial>
Jul 28 00:44:17 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:44:17 user nova-compute[70709]: </disk>
Jul 28 00:44:17 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:44:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690505057.970029, 4658dea2-f6e3-47db-8e37-97d64c70fe4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:44:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:44:17 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Successfully detached device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the live domain config.
Jul 28 00:44:17 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:44:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcZGzLgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:44:17 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:44:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:44:17 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:44:17 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa6fa3d-c428-4684-968c-7429aa18421a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:44:18 user nova-compute[70709]: No targets found.
Jul 28 00:44:18 user nova-compute[70709]: iSNS:
Jul 28 00:44:18 user nova-compute[70709]: No targets found.
Jul 28 00:44:18 user nova-compute[70709]: STATIC:
Jul 28 00:44:18 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412
Jul 28 00:44:18 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:44:18 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:44:18 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d
Jul 28 00:44:18 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:44:18 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:44:18 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb
Jul 28 00:44:18 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:44:18 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:44:18 user nova-compute[70709]: FIRMWARE:
Jul 28 00:44:18 user nova-compute[70709]: No targets found.
Jul 28 00:44:18 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:44:18 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:44:18 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b860eb-dea6-4053-9d1f-1c1a3c1dc3d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d112944-31b3-4e2c-8b9c-fa7e45a5ff34]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:44:18 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:44:18 user nova-compute[70709]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 (non-flash)
Jul 28 00:44:18 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:44:18 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:44:18 user nova-compute[70709]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 (non-flash)
Jul 28 00:44:18 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b906eb520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412'): ({'sdd'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Removing single pathed devices sdd {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0552d263-87a7-4cf4-a419-fd71c6ed3314]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee1359f-8efd-48a1-b07f-bdad3cf013be]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Flushing IO for device /dev/sdd {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b28c1cb-3668-47a6-9a19-e34108d8a3c8]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2f94f0-5ca8-4354-956f-84ae5457172c]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e646086-8d3e-4800-86d2-26d3783d5403]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b74951-8363-4e89-89a9-d582b6096bcc]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412, portal: 172.16.0.220,3260]
Jul 28 00:44:18 user nova-compute[70709]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412, portal: 172.16.0.220,3260] successful.
Jul 28 00:44:18 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d6cf4a-c26f-4a6c-8803-33bb344c7412 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc69b1f6-539d-4113-acda-6f57a74757ad]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== disconnect_volume: return (302ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:44:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:19 user nova-compute[70709]: DEBUG nova.objects.instance [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:44:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f66303f0-1788-44ee-bd4f-8868bc498cbc tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.600s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:44:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:30 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:44:30 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:44:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:44:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:44:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:44:30 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:44:30 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:44:32 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:44:32 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:44:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8139MB free_disk=25.196758270263672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 730e1d50-7320-4c5a-a57f-c5e7a2066a16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance d76e49c9-7dc6-444f-a347-2ab782f56144 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 09eee7ad-3463-46f6-8348-b68cb1b20a11 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:44:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:44:33 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:44:33 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:44:33 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:44:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:44:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:36 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:44:36 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:44:36 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:44:36 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:44:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:40 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:44:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:44:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:44:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:44:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:44:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:43 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:44:44 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:44:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:44:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:44:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:44:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:44:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:44:46 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:44:46 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:44:46 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updating instance_info_cache with network_info: [{"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:44:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:44:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:44:46 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:44:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:44:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:44:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:45:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:45:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:45:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:45:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:45:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:45:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:45:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:13 user nova-compute[70709]: DEBUG nova.objects.instance [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:13 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:13 user nova-compute[70709]: INFO nova.compute.manager [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attaching volume 281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 to /dev/vdb
Jul 28 00:45:14 user nova-compute[70709]: DEBUG os_brick.utils [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[efddb4f9-56b0-4c79-a80d-5145a02f1245]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaae875-64a5-4dd9-96f0-33566526c349]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb29eda9-f829-4773-8aaf-4a46f4cc56cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f250d2-6b24-455a-af66-cee3ce844d39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:45:14 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:45:14 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5ca5e8-34d2-4270-a2d6-c9e370ddaf97]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG os_brick.utils [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:45:14 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updating existing volume attachment record: 28cb06b7-7a69-4d3f-abcf-76b8a35c6e25 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:45:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:45:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:45:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:45:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:45:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:45:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmyvHPNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:45:21 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:45:21 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:45:21 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fd67ac-ef29-4874-a480-a2c0be7784cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:45:21 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b55d6d7-b3a2-4585-b651-7bb505db8260]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68] added
Jul 28 00:45:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e139e7b0-161c-42d8-b07b-3b39ee5c1b1d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e48accc-e9c8-4359-a666-ce25a2d3d49e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmyvHPNL {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmyvHPNL" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[741e7515-dee0-45f5-8cb6-9315f119142f]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmyvHPNL'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e502c5d3-e045-45ce-a2e3-deb6a33521d8]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d550cfa-30c7-40e3-9f7f-9149f4c150c9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:21 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:45:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:21 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:45:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[37826af3-a5ac-4b4a-8e22-b8b201d3354d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68, portal: 172.16.0.220,3260]
Jul 28 00:45:21 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68, portal: 172.16.0.220,3260] successful.
Jul 28 00:45:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5e8e2b-d694-4826-9ae9-eac519f8ac13]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c247e5-bb67-4bfd-9c01-2f773286e04b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:21 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:45:21 user nova-compute[70709]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 (non-flash)
Jul 28 00:45:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:21 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:45:21 user nova-compute[70709]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 (non-flash)
Jul 28 00:45:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c260d7-6fd9-43ce-b6e4-a1abae278b78]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:45:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:22 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:45:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmyvHPNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:45:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:45:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26462386634656163', 'path': '/dev/sdd'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:45:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462386634656163', 'path': '/dev/sdd'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:45:22 user nova-compute[70709]: DEBUG nova.objects.instance [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:45:22 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:45:22 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:45:22 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:45:22 user nova-compute[70709]:   <serial>281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68</serial>
Jul 28 00:45:22 user nova-compute[70709]: </disk>
Jul 28 00:45:22 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:45:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:45:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:45:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] No VIF found with MAC fa:16:3e:01:51:d2, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:45:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-540094b7-3e1e-40b8-93d5-7032eb662c97 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.921s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:25 user nova-compute[70709]: INFO nova.compute.manager [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Detaching volume 281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68
Jul 28 00:45:25 user nova-compute[70709]: INFO nova.virt.block_device [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Attempting to driver detach volume 281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 from mountpoint /dev/vdb
Jul 28 00:45:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Attempting to detach device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:45:25 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:45:25 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:45:25 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:45:25 user nova-compute[70709]:   <serial>281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68</serial>
Jul 28 00:45:25 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:45:25 user nova-compute[70709]: </disk>
Jul 28 00:45:25 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:45:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Successfully detached device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the persistent domain config.
Jul 28 00:45:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:45:25 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:45:25 user nova-compute[70709]:   <source dev="/dev/sdd"/>
Jul 28 00:45:25 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:45:25 user nova-compute[70709]:   <serial>281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68</serial>
Jul 28 00:45:25 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:45:25 user nova-compute[70709]: </disk>
Jul 28 00:45:25 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690505125.741021, 4658dea2-f6e3-47db-8e37-97d64c70fe4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:45:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Successfully detached device vdb from instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c from the live domain config.
Jul 28 00:45:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmyvHPNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:45:25 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92018fc-7171-412a-b6b6-231e4a0e7f44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:45:25 user nova-compute[70709]: No targets found.
Jul 28 00:45:25 user nova-compute[70709]: iSNS:
Jul 28 00:45:25 user nova-compute[70709]: No targets found.
Jul 28 00:45:25 user nova-compute[70709]: STATIC:
Jul 28 00:45:25 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68
Jul 28 00:45:25 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:45:25 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:45:25 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d
Jul 28 00:45:25 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:45:25 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:45:25 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb
Jul 28 00:45:25 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:45:25 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:45:25 user nova-compute[70709]: FIRMWARE:
Jul 28 00:45:25 user nova-compute[70709]: No targets found.
Jul 28 00:45:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:45:25 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:45:25 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45c8d85-6bd3-4618-92b7-69866860ec89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[308ba1db-2e71-4c07-b567-2b51405102ba]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:25 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:45:25 user nova-compute[70709]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 (non-flash)
Jul 28 00:45:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:25 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:45:25 user nova-compute[70709]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 (non-flash)
Jul 28 00:45:25 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b88380af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68'): ({'sdd'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Removing single pathed devices sdd {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c7b2e0-77be-4b08-acca-e9511c461d1f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d9a32c-bfc1-43ec-8b8e-cc8e5c1f5696]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Flushing IO for device /dev/sdd {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c0bdc6-77f7-4302-bd7d-9db5d73e186d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c948f3-5e41-47c3-8312-f7c44999ea0b]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] SCSI volumes sdd have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd8d38-25a3-46f0-88e0-25b6b04e5613]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:25 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57bd0e2-e6d3-48f5-9c62-633fa223462b]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68, portal: 172.16.0.220,3260]
Jul 28 00:45:26 user nova-compute[70709]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68, portal: 172.16.0.220,3260] successful.
Jul 28 00:45:26 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281d91b1-418d-4a3b-a6ec-a8ddb8ccbe68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3394897a-df64-49cb-bf3d-4bf441a36ce4]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] <== disconnect_volume: return (296ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG nova.objects.instance [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'flavor' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-0881218e-7042-4891-a96a-7ae23ebc17ef tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.590s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:45:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:30 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:45:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:32 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:45:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:45:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:45:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:45:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:34 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:45:34 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:45:34 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=25.18780517578125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:45:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 730e1d50-7320-4c5a-a57f-c5e7a2066a16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance d76e49c9-7dc6-444f-a347-2ab782f56144 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 09eee7ad-3463-46f6-8348-b68cb1b20a11 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:45:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-e0d26460-56ff-4900-ab94-ee7a8758d2e1 req-cf5b2a40-e39b-46b6-99ac-54bf125d8267 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-changed-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:45:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-e0d26460-56ff-4900-ab94-ee7a8758d2e1 req-cf5b2a40-e39b-46b6-99ac-54bf125d8267 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Refreshing instance network info cache due to event network-changed-0ca782ea-ee7e-4a72-8830-8aa6194b072c. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:45:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e0d26460-56ff-4900-ab94-ee7a8758d2e1 req-cf5b2a40-e39b-46b6-99ac-54bf125d8267 service nova] Acquiring lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:45:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e0d26460-56ff-4900-ab94-ee7a8758d2e1 req-cf5b2a40-e39b-46b6-99ac-54bf125d8267 service nova] Acquired lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:45:36 user nova-compute[70709]: DEBUG nova.network.neutron [req-e0d26460-56ff-4900-ab94-ee7a8758d2e1 req-cf5b2a40-e39b-46b6-99ac-54bf125d8267 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Refreshing network info cache for port 0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:45:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:45:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'flavor' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:37 user nova-compute[70709]: INFO nova.compute.manager [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Attaching volume f672fd95-8126-42b2-bf2a-2528506698b9 to /dev/vdb
Jul 28 00:45:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-e0d26460-56ff-4900-ab94-ee7a8758d2e1 req-cf5b2a40-e39b-46b6-99ac-54bf125d8267 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updated VIF entry in instance network info cache for port 0ca782ea-ee7e-4a72-8830-8aa6194b072c. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-e0d26460-56ff-4900-ab94-ee7a8758d2e1 req-cf5b2a40-e39b-46b6-99ac-54bf125d8267 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updating instance_info_cache with network_info: [{"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG os_brick.utils [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e0d26460-56ff-4900-ab94-ee7a8758d2e1 req-cf5b2a40-e39b-46b6-99ac-54bf125d8267 service nova] Releasing lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7367c451-e5f4-4d0d-b160-da2453fc2c14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d6bc70-f63e-4bc1-8521-3d60f3cda7dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cac4d8-e9a7-4d80-b8c4-34d8902bd928]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d379c2-a9a8-4197-8b91-f695a92e1082]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:45:37 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:45:37 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5399f7ff-9ce5-4c5c-a6b3-49f829dfb6d0]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG os_brick.utils [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:45:37 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updating existing volume attachment record: 59f3f205-82a7-4cc1-94a6-30548d71c55f {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:45:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:40 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:45:40 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:45:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 00:45:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-cd6df6da-7573-41ff-b009-5dce42421c77 req-9fb2455c-6c81-46ca-86bc-29bf442f7db1 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received event network-changed-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:45:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-cd6df6da-7573-41ff-b009-5dce42421c77 req-9fb2455c-6c81-46ca-86bc-29bf442f7db1 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Refreshing instance network info cache due to event network-changed-129da7ca-f400-4977-8eaf-daa2868e20fd. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:45:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cd6df6da-7573-41ff-b009-5dce42421c77 req-9fb2455c-6c81-46ca-86bc-29bf442f7db1 service nova] Acquiring lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:45:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cd6df6da-7573-41ff-b009-5dce42421c77 req-9fb2455c-6c81-46ca-86bc-29bf442f7db1 service nova] Acquired lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:45:44 user nova-compute[70709]: DEBUG nova.network.neutron [req-cd6df6da-7573-41ff-b009-5dce42421c77 req-9fb2455c-6c81-46ca-86bc-29bf442f7db1 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Refreshing network info cache for port 129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:45:45 user nova-compute[70709]: DEBUG nova.network.neutron [req-cd6df6da-7573-41ff-b009-5dce42421c77 req-9fb2455c-6c81-46ca-86bc-29bf442f7db1 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Updated VIF entry in instance network info cache for port 129da7ca-f400-4977-8eaf-daa2868e20fd. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:45:45 user nova-compute[70709]: DEBUG nova.network.neutron [req-cd6df6da-7573-41ff-b009-5dce42421c77 req-9fb2455c-6c81-46ca-86bc-29bf442f7db1 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Updating instance_info_cache with network_info: [{"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:45:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cd6df6da-7573-41ff-b009-5dce42421c77 req-9fb2455c-6c81-46ca-86bc-29bf442f7db1 service nova] Releasing lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:45:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:45:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:45:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:45:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:45:45 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updating instance_info_cache with network_info: [{"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-98f3bf3a-1362-4997-812c-d557ae12d445 req-ffa2159e-89af-4dc5-bcc3-1009d3bfff98 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received event network-changed-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-98f3bf3a-1362-4997-812c-d557ae12d445 req-ffa2159e-89af-4dc5-bcc3-1009d3bfff98 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Refreshing instance network info cache due to event network-changed-129da7ca-f400-4977-8eaf-daa2868e20fd. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98f3bf3a-1362-4997-812c-d557ae12d445 req-ffa2159e-89af-4dc5-bcc3-1009d3bfff98 service nova] Acquiring lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98f3bf3a-1362-4997-812c-d557ae12d445 req-ffa2159e-89af-4dc5-bcc3-1009d3bfff98 service nova] Acquired lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG nova.network.neutron [req-98f3bf3a-1362-4997-812c-d557ae12d445 req-ffa2159e-89af-4dc5-bcc3-1009d3bfff98 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Refreshing network info cache for port 129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "09eee7ad-3463-46f6-8348-b68cb1b20a11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:46 user nova-compute[70709]: INFO nova.compute.manager [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Terminating instance
Jul 28 00:45:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-23c83753-74f3-4939-b99c-3d9db6e271cc req-f7b43707-d9d3-4ea4-b867-aead73d464b0 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received event network-vif-unplugged-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-23c83753-74f3-4939-b99c-3d9db6e271cc req-f7b43707-d9d3-4ea4-b867-aead73d464b0 service nova] Acquiring lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-23c83753-74f3-4939-b99c-3d9db6e271cc req-f7b43707-d9d3-4ea4-b867-aead73d464b0 service nova] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-23c83753-74f3-4939-b99c-3d9db6e271cc req-f7b43707-d9d3-4ea4-b867-aead73d464b0 service nova] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-23c83753-74f3-4939-b99c-3d9db6e271cc req-f7b43707-d9d3-4ea4-b867-aead73d464b0 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] No waiting events found dispatching network-vif-unplugged-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-23c83753-74f3-4939-b99c-3d9db6e271cc req-f7b43707-d9d3-4ea4-b867-aead73d464b0 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received event network-vif-unplugged-129da7ca-f400-4977-8eaf-daa2868e20fd for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.network.neutron [req-98f3bf3a-1362-4997-812c-d557ae12d445 req-ffa2159e-89af-4dc5-bcc3-1009d3bfff98 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Updated VIF entry in instance network info cache for port 129da7ca-f400-4977-8eaf-daa2868e20fd. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.network.neutron [req-98f3bf3a-1362-4997-812c-d557ae12d445 req-ffa2159e-89af-4dc5-bcc3-1009d3bfff98 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Updating instance_info_cache with network_info: [{"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-98f3bf3a-1362-4997-812c-d557ae12d445 req-ffa2159e-89af-4dc5-bcc3-1009d3bfff98 service nova] Releasing lock "refresh_cache-09eee7ad-3463-46f6-8348-b68cb1b20a11" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:45:47 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Instance destroyed successfully.
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.objects.instance [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'resources' on Instance uuid 09eee7ad-3463-46f6-8348-b68cb1b20a11 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1680581561',display_name='tempest-TestVolumeBootPattern-server-1680581561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1680581561',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJASKlujGBh7q4FjBKCwUDBKdkAi9ZlmeDUwzkD1Smbvo/bJjZcXJHiVRyG3yLb9/84JrQ3NFZZ8DFC79UmemaYV3pBVbiAP8M5fiEEtqWcYd/Pk5XyfaCP8BM8JvkX0XQ==',key_name='tempest-TestVolumeBootPattern-248605266',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:44:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-9gazj65m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:44:06Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=09eee7ad-3463-46f6-8348-b68cb1b20a11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "129da7ca-f400-4977-8eaf-daa2868e20fd", "address": "fa:16:3e:e4:af:48", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129da7ca-f4", "ovs_interfaceid": "129da7ca-f400-4977-8eaf-daa2868e20fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:af:48,bridge_name='br-int',has_traffic_filtering=True,id=129da7ca-f400-4977-8eaf-daa2868e20fd,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129da7ca-f4') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_vif [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:af:48,bridge_name='br-int',has_traffic_filtering=True,id=129da7ca-f400-4977-8eaf-daa2868e20fd,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129da7ca-f4') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap129da7ca-f4, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:45:47 user nova-compute[70709]: INFO os_vif [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:af:48,bridge_name='br-int',has_traffic_filtering=True,id=129da7ca-f400-4977-8eaf-daa2868e20fd,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129da7ca-f4')
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcFRJOMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:45:47 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdefd607-f32a-4306-b79e-9acbac529849]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:45:47 user nova-compute[70709]: No targets found.
Jul 28 00:45:47 user nova-compute[70709]: iSNS:
Jul 28 00:45:47 user nova-compute[70709]: No targets found.
Jul 28 00:45:47 user nova-compute[70709]: STATIC:
Jul 28 00:45:47 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d
Jul 28 00:45:47 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:45:47 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:45:47 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb
Jul 28 00:45:47 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:45:47 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:45:47 user nova-compute[70709]: FIRMWARE:
Jul 28 00:45:47 user nova-compute[70709]: No targets found.
Jul 28 00:45:47 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:45:47 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:45:47 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec0d16a-0897-425b-aa8f-6acebd688a73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[19450b01-97d8-4daf-a4c1-cf9903d776e0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:47 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:45:47 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:47 user nova-compute[70709]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb (non-flash)
Jul 28 00:45:47 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b91dd2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb'): ({'sdb'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Removing single pathed devices sdb {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0880cda1-9609-42db-b945-ecf1444dfad5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9026f70c-1e06-444e-aad5-394d6bd4f80b]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flushing IO for device /dev/sdb {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b0eabb-b4b0-4aad-b2b2-b5bbf303fc04]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[18692174-bf72-434f-a68c-62b1feb9eb85]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4dc1591',) {{(pid=82455) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb5c9fc-7dc2-4af1-a30a-bb052023d411]: (4, None) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c361f3cf-1649-4102-8d39-4055dab73296]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[728352f3-2a15-4aaf-b7c4-8ea6edd5423d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb, portal: 172.16.0.220,3260]
Jul 28 00:45:47 user nova-compute[70709]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb, portal: 172.16.0.220,3260] successful.
Jul 28 00:45:47 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21b60881-e898-41d7-ba14-4296f13692fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea7d16-d180-422d-ac0f-27c5e6b858f0]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== disconnect_volume: return (309ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:45:47 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Deleting instance files /opt/stack/data/nova/instances/09eee7ad-3463-46f6-8348-b68cb1b20a11_del
Jul 28 00:45:47 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Deletion of /opt/stack/data/nova/instances/09eee7ad-3463-46f6-8348-b68cb1b20a11_del complete
Jul 28 00:45:47 user nova-compute[70709]: INFO nova.compute.manager [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 28 00:45:47 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:45:47 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:45:48 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Took 0.60 seconds to deallocate network for instance.
Jul 28 00:45:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQlJGqkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:45:48 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:45:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:45:48 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:45:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:45:48 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[628bf263-a70e-49d2-b75d-fc67767887c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:45:48 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9da923c-a2e7-4e49-aa38-e6deeecc30e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9] added
Jul 28 00:45:48 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ce3c50-0dd7-4e2e-89dd-fb6ee2b1b27a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d2b6d7-7142-48c5-b767-6229c3ef095c]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQlJGqkI {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQlJGqkI" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89e31c1-03d5-49aa-ae01-494a6b36ab3a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AQlJGqkI'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[22af59bb-0437-444e-8d5f-aa621342f364]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb30344-d947-428e-bdfb-9c261d4cbf44]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:49 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:49 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a4eca3-04ed-4600-af78-a0054ef47440]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9, portal: 172.16.0.220,3260]
Jul 28 00:45:49 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9, portal: 172.16.0.220,3260] successful.
Jul 28 00:45:49 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e84015b-47d0-4881-9296-2141adc21d71]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf9f0d0-63fe-49ba-afa0-9e1cfb1db2db]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:49 user nova-compute[70709]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 (non-flash)
Jul 28 00:45:49 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:45:49 user nova-compute[70709]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 (non-flash)
Jul 28 00:45:49 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb796bd4-d204-42fb-a017-a296b53a699f]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQlJGqkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-11e4ed61-c201-443c-b863-42ac0651fa9c req-a2b5bd18-23e5-4e83-bb42-a66b62b5ab37 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received event network-vif-plugged-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-11e4ed61-c201-443c-b863-42ac0651fa9c req-a2b5bd18-23e5-4e83-bb42-a66b62b5ab37 service nova] Acquiring lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-11e4ed61-c201-443c-b863-42ac0651fa9c req-a2b5bd18-23e5-4e83-bb42-a66b62b5ab37 service nova] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-11e4ed61-c201-443c-b863-42ac0651fa9c req-a2b5bd18-23e5-4e83-bb42-a66b62b5ab37 service nova] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-11e4ed61-c201-443c-b863-42ac0651fa9c req-a2b5bd18-23e5-4e83-bb42-a66b62b5ab37 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] No waiting events found dispatching network-vif-plugged-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:45:49 user nova-compute[70709]: WARNING nova.compute.manager [req-11e4ed61-c201-443c-b863-42ac0651fa9c req-a2b5bd18-23e5-4e83-bb42-a66b62b5ab37 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received unexpected event network-vif-plugged-129da7ca-f400-4977-8eaf-daa2868e20fd for instance with vm_state active and task_state deleting.
Jul 28 00:45:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-11e4ed61-c201-443c-b863-42ac0651fa9c req-a2b5bd18-23e5-4e83-bb42-a66b62b5ab37 service nova] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Received event network-vif-deleted-129da7ca-f400-4977-8eaf-daa2868e20fd {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:45:49 user nova-compute[70709]: INFO nova.compute.manager [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Took 1.07 seconds to detach 1 volumes for instance.
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:45:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:50 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Deleted allocations for instance 09eee7ad-3463-46f6-8348-b68cb1b20a11
Jul 28 00:45:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-75631d3f-a097-45e2-bdaf-06d9b46efc6e tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "09eee7ad-3463-46f6-8348-b68cb1b20a11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.295s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:45:50 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26238353663343430', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:45:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238353663343430', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:45:50 user nova-compute[70709]: DEBUG nova.objects.instance [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'flavor' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] attach device xml: <disk type="block" device="disk">
Jul 28 00:45:50 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:45:50 user nova-compute[70709]:   <source dev="/dev/sdb"/>
Jul 28 00:45:50 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:45:50 user nova-compute[70709]:   <serial>f672fd95-8126-42b2-bf2a-2528506698b9</serial>
Jul 28 00:45:50 user nova-compute[70709]: </disk>
Jul 28 00:45:50 user nova-compute[70709]:  {{(pid=70709) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 28 00:45:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:45:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:45:50 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No VIF found with MAC fa:16:3e:75:a1:0a, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:45:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-b61b4c72-fb7c-48ed-b697-174c3e2954dc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.564s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:51 user nova-compute[70709]: INFO nova.compute.manager [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Rescuing
Jul 28 00:45:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:45:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquired lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:45:51 user nova-compute[70709]: DEBUG nova.network.neutron [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:45:51 user nova-compute[70709]: DEBUG nova.network.neutron [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updating instance_info_cache with network_info: [{"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:45:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Releasing lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-8e4d5813-df5c-4d5d-b4dd-b6377e847b0d req-70e716fe-db7e-4f2b-9b26-7ea5f61ff462 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-unplugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8e4d5813-df5c-4d5d-b4dd-b6377e847b0d req-70e716fe-db7e-4f2b-9b26-7ea5f61ff462 service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8e4d5813-df5c-4d5d-b4dd-b6377e847b0d req-70e716fe-db7e-4f2b-9b26-7ea5f61ff462 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8e4d5813-df5c-4d5d-b4dd-b6377e847b0d req-70e716fe-db7e-4f2b-9b26-7ea5f61ff462 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-8e4d5813-df5c-4d5d-b4dd-b6377e847b0d req-70e716fe-db7e-4f2b-9b26-7ea5f61ff462 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-unplugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:45:52 user nova-compute[70709]: WARNING nova.compute.manager [req-8e4d5813-df5c-4d5d-b4dd-b6377e847b0d req-70e716fe-db7e-4f2b-9b26-7ea5f61ff462 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received unexpected event network-vif-unplugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with vm_state active and task_state rescuing.
Jul 28 00:45:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Instance destroyed successfully.
Jul 28 00:45:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Attempting rescue
Jul 28 00:45:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70709) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Instance directory exists: not creating {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 28 00:45:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Creating image(s)
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "/opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "/opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'trusted_certs' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.128s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.rescue {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.rescue" returned: 0 in 0.055s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:52 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'migration_context' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Start _get_guest_xml network_info=[{"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "vif_mac": "fa:16:3e:75:a1:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'resources' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'numa_topology' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:53 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:45:53 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'vcpu_model' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2129512621',display_name='tempest-ServerRescueNegativeTestJSON-server-2129512621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2129512621',id=47,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIkjUZ8Ct3mkPHoB8VEfjyVbahhtK6LD1UExufiyJWkyxpLp3IwdHejllwZCdIwOmmIqSZgxaTPuNXf8aWJu+qgQFjbX6HpxP3hRRLTjKq+Pqfkh4kCGjRFHm0qQCv1pg==',key_name='tempest-keypair-2132315906',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:43:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-xdxw3fk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:43:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8afed76354148e290f0b4f602616818',uuid=d76e49c9-7dc6-444f-a347-2ab782f56144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "vif_mac": "fa:16:3e:75:a1:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "vif_mac": "fa:16:3e:75:a1:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=0ca782ea-ee7e-4a72-8830-8aa6194b072c,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca782ea-ee') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'pci_devices' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:45:53 user nova-compute[70709]:   <uuid>d76e49c9-7dc6-444f-a347-2ab782f56144</uuid>
Jul 28 00:45:53 user nova-compute[70709]:   <name>instance-0000002f</name>
Jul 28 00:45:53 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:45:53 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:45:53 user nova-compute[70709]:   <metadata>
Jul 28 00:45:53 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:45:53 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:45:53 user nova-compute[70709]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2129512621</nova:name>
Jul 28 00:45:53 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:45:53</nova:creationTime>
Jul 28 00:45:53 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:45:53 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:45:53 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:45:53 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:45:53 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:45:53 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:45:53 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:45:53 user nova-compute[70709]:       <nova:owner>
Jul 28 00:45:53 user nova-compute[70709]:         <nova:user uuid="d8afed76354148e290f0b4f602616818">tempest-ServerRescueNegativeTestJSON-1040689578-project-member</nova:user>
Jul 28 00:45:53 user nova-compute[70709]:         <nova:project uuid="ad38eeba09ce4551899f892ea787ea1c">tempest-ServerRescueNegativeTestJSON-1040689578</nova:project>
Jul 28 00:45:53 user nova-compute[70709]:       </nova:owner>
Jul 28 00:45:53 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:45:53 user nova-compute[70709]:       <nova:ports>
Jul 28 00:45:53 user nova-compute[70709]:         <nova:port uuid="0ca782ea-ee7e-4a72-8830-8aa6194b072c">
Jul 28 00:45:53 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 28 00:45:53 user nova-compute[70709]:         </nova:port>
Jul 28 00:45:53 user nova-compute[70709]:       </nova:ports>
Jul 28 00:45:53 user nova-compute[70709]:     </nova:instance>
Jul 28 00:45:53 user nova-compute[70709]:   </metadata>
Jul 28 00:45:53 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:45:53 user nova-compute[70709]:     <system>
Jul 28 00:45:53 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:45:53 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:45:53 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:45:53 user nova-compute[70709]:       <entry name="serial">d76e49c9-7dc6-444f-a347-2ab782f56144</entry>
Jul 28 00:45:53 user nova-compute[70709]:       <entry name="uuid">d76e49c9-7dc6-444f-a347-2ab782f56144</entry>
Jul 28 00:45:53 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:45:53 user nova-compute[70709]:     </system>
Jul 28 00:45:53 user nova-compute[70709]:   </sysinfo>
Jul 28 00:45:53 user nova-compute[70709]:   <os>
Jul 28 00:45:53 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:45:53 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:45:53 user nova-compute[70709]:   </os>
Jul 28 00:45:53 user nova-compute[70709]:   <features>
Jul 28 00:45:53 user nova-compute[70709]:     <acpi/>
Jul 28 00:45:53 user nova-compute[70709]:     <apic/>
Jul 28 00:45:53 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:45:53 user nova-compute[70709]:   </features>
Jul 28 00:45:53 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:45:53 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:45:53 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:45:53 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:45:53 user nova-compute[70709]:   </clock>
Jul 28 00:45:53 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:45:53 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:45:53 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:45:53 user nova-compute[70709]:   </cpu>
Jul 28 00:45:53 user nova-compute[70709]:   <devices>
Jul 28 00:45:53 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:45:53 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:45:53 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.rescue"/>
Jul 28 00:45:53 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:45:53 user nova-compute[70709]:     </disk>
Jul 28 00:45:53 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:45:53 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:45:53 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk"/>
Jul 28 00:45:53 user nova-compute[70709]:       <target dev="vdb" bus="virtio"/>
Jul 28 00:45:53 user nova-compute[70709]:     </disk>
Jul 28 00:45:53 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:45:53 user nova-compute[70709]:       <mac address="fa:16:3e:75:a1:0a"/>
Jul 28 00:45:53 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:45:53 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:45:53 user nova-compute[70709]:       <target dev="tap0ca782ea-ee"/>
Jul 28 00:45:53 user nova-compute[70709]:     </interface>
Jul 28 00:45:53 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:45:53 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/console.log" append="off"/>
Jul 28 00:45:53 user nova-compute[70709]:     </serial>
Jul 28 00:45:53 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:45:53 user nova-compute[70709]:     <video>
Jul 28 00:45:53 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:45:53 user nova-compute[70709]:     </video>
Jul 28 00:45:53 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:45:53 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:45:53 user nova-compute[70709]:     </rng>
Jul 28 00:45:53 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:45:53 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:45:53 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:45:53 user nova-compute[70709]:     </memballoon>
Jul 28 00:45:53 user nova-compute[70709]:   </devices>
Jul 28 00:45:53 user nova-compute[70709]: </domain>
Jul 28 00:45:53 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:45:53 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Instance destroyed successfully.
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] No VIF found with MAC fa:16:3e:75:a1:0a, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:45:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-1aa9dfb0-7438-4240-a46b-018f640abfa2 req-76c58400-d543-46bf-8b3b-7cf3599e78c4 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:45:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1aa9dfb0-7438-4240-a46b-018f640abfa2 req-76c58400-d543-46bf-8b3b-7cf3599e78c4 service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1aa9dfb0-7438-4240-a46b-018f640abfa2 req-76c58400-d543-46bf-8b3b-7cf3599e78c4 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1aa9dfb0-7438-4240-a46b-018f640abfa2 req-76c58400-d543-46bf-8b3b-7cf3599e78c4 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-1aa9dfb0-7438-4240-a46b-018f640abfa2 req-76c58400-d543-46bf-8b3b-7cf3599e78c4 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:45:54 user nova-compute[70709]: WARNING nova.compute.manager [req-1aa9dfb0-7438-4240-a46b-018f640abfa2 req-76c58400-d543-46bf-8b3b-7cf3599e78c4 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received unexpected event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with vm_state active and task_state rescuing.
Jul 28 00:45:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:45:56 user nova-compute[70709]: WARNING nova.compute.manager [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received unexpected event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with vm_state active and task_state rescuing.
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.compute.manager [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:45:56 user nova-compute[70709]: WARNING nova.compute.manager [req-e7f24fe2-44fb-400c-b892-53eeb676a5e9 req-375b96c8-5395-4179-99e2-317b89a64b00 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received unexpected event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with vm_state active and task_state rescuing.
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for d76e49c9-7dc6-444f-a347-2ab782f56144 due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505156.5724583, d76e49c9-7dc6-444f-a347-2ab782f56144 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:45:56 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] VM Resumed (Lifecycle Event)
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8862964e-fff6-4f4e-b9be-23c5a86d3627 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:45:56 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505156.575348, d76e49c9-7dc6-444f-a347-2ab782f56144 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:45:56 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] VM Started (Lifecycle Event)
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:45:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:45:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:45:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:02 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690505147.5428026, 09eee7ad-3463-46f6-8348-b68cb1b20a11 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:46:02 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] VM Stopped (Lifecycle Event)
Jul 28 00:46:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-188d35c8-63e9-45af-be38-24471b2b4d41 None None] [instance: 09eee7ad-3463-46f6-8348-b68cb1b20a11] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:46:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:02 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 00:46:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 00:46:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:46:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:32 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:32 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:32 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:32 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:46:32 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:46:32 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:46:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:34 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:46:34 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:46:34 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8316MB free_disk=25.18520736694336GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:46:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 730e1d50-7320-4c5a-a57f-c5e7a2066a16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance d76e49c9-7dc6-444f-a347-2ab782f56144 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:46:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:46:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:46:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:46:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:46:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:46:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:40 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:46 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:46:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:46:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:46:46 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updating instance_info_cache with network_info: [{"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-4658dea2-f6e3-47db-8e37-97d64c70fe4c" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-cee65a68-5d68-4690-be1a-7256a7ef7a55 req-7b0b95c3-6934-4ea4-80cb-1feb93a34ee7 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received event network-changed-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-cee65a68-5d68-4690-be1a-7256a7ef7a55 req-7b0b95c3-6934-4ea4-80cb-1feb93a34ee7 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Refreshing instance network info cache due to event network-changed-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cee65a68-5d68-4690-be1a-7256a7ef7a55 req-7b0b95c3-6934-4ea4-80cb-1feb93a34ee7 service nova] Acquiring lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cee65a68-5d68-4690-be1a-7256a7ef7a55 req-7b0b95c3-6934-4ea4-80cb-1feb93a34ee7 service nova] Acquired lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG nova.network.neutron [req-cee65a68-5d68-4690-be1a-7256a7ef7a55 req-7b0b95c3-6934-4ea4-80cb-1feb93a34ee7 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Refreshing network info cache for port f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:47 user nova-compute[70709]: INFO nova.compute.manager [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Terminating instance
Jul 28 00:46:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-9f23d294-5e4b-494d-948c-e61a28933994 req-d7b955cb-4a7c-4ed1-ba60-4aa8821effb0 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received event network-vif-unplugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9f23d294-5e4b-494d-948c-e61a28933994 req-d7b955cb-4a7c-4ed1-ba60-4aa8821effb0 service nova] Acquiring lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9f23d294-5e4b-494d-948c-e61a28933994 req-d7b955cb-4a7c-4ed1-ba60-4aa8821effb0 service nova] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-9f23d294-5e4b-494d-948c-e61a28933994 req-d7b955cb-4a7c-4ed1-ba60-4aa8821effb0 service nova] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-9f23d294-5e4b-494d-948c-e61a28933994 req-d7b955cb-4a7c-4ed1-ba60-4aa8821effb0 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] No waiting events found dispatching network-vif-unplugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-9f23d294-5e4b-494d-948c-e61a28933994 req-d7b955cb-4a7c-4ed1-ba60-4aa8821effb0 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received event network-vif-unplugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG nova.network.neutron [req-cee65a68-5d68-4690-be1a-7256a7ef7a55 req-7b0b95c3-6934-4ea4-80cb-1feb93a34ee7 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Updated VIF entry in instance network info cache for port f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG nova.network.neutron [req-cee65a68-5d68-4690-be1a-7256a7ef7a55 req-7b0b95c3-6934-4ea4-80cb-1feb93a34ee7 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Updating instance_info_cache with network_info: [{"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cee65a68-5d68-4690-be1a-7256a7ef7a55 req-7b0b95c3-6934-4ea4-80cb-1feb93a34ee7 service nova] Releasing lock "refresh_cache-730e1d50-7320-4c5a-a57f-c5e7a2066a16" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:48 user nova-compute[70709]: INFO nova.compute.manager [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Terminating instance
Jul 28 00:46:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:48 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Instance destroyed successfully.
Jul 28 00:46:48 user nova-compute[70709]: DEBUG nova.objects.instance [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lazy-loading 'resources' on Instance uuid 730e1d50-7320-4c5a-a57f-c5e7a2066a16 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-18726427',display_name='tempest-TestVolumeBootPattern-server-18726427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-18726427',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJASKlujGBh7q4FjBKCwUDBKdkAi9ZlmeDUwzkD1Smbvo/bJjZcXJHiVRyG3yLb9/84JrQ3NFZZ8DFC79UmemaYV3pBVbiAP8M5fiEEtqWcYd/Pk5XyfaCP8BM8JvkX0XQ==',key_name='tempest-TestVolumeBootPattern-248605266',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:42:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47d88e18679b4bc49c010b68ca813dab',ramdisk_id='',reservation_id='r-t3uy5gh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2090046407',owner_user_name='tempest-TestVolumeBootPattern-2090046407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:42:01Z,user_data=None,user_id='d994eb215f204b029d183b73539e3d4d',uuid=730e1d50-7320-4c5a-a57f-c5e7a2066a16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converting VIF {"id": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "address": "fa:16:3e:22:71:9e", "network": {"id": "b7da628e-9b01-4846-98cc-9f7ed2751088", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600083464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47d88e18679b4bc49c010b68ca813dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15ef2c2-3c", "ovs_interfaceid": "f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:71:9e,bridge_name='br-int',has_traffic_filtering=True,id=f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15ef2c2-3c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_vif [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:71:9e,bridge_name='br-int',has_traffic_filtering=True,id=f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15ef2c2-3c') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf15ef2c2-3c, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:48 user nova-compute[70709]: INFO os_vif [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:71:9e,bridge_name='br-int',has_traffic_filtering=True,id=f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575,network=Network(b7da628e-9b01-4846-98cc-9f7ed2751088),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15ef2c2-3c')
Jul 28 00:46:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzKoQUxu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:46:48 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b3fe47-05a0-4b11-ad38-04689cd46865]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:46:48 user nova-compute[70709]: No targets found.
Jul 28 00:46:48 user nova-compute[70709]: iSNS:
Jul 28 00:46:48 user nova-compute[70709]: No targets found.
Jul 28 00:46:48 user nova-compute[70709]: STATIC:
Jul 28 00:46:48 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9
Jul 28 00:46:48 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:46:48 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:46:48 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d
Jul 28 00:46:48 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:46:48 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:46:48 user nova-compute[70709]: FIRMWARE:
Jul 28 00:46:48 user nova-compute[70709]: No targets found.
Jul 28 00:46:48 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:46:48 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:46:48 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b25016-bbe9-41c1-a5ef-2a1bffd6d191]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9a2c17-1e50-4205-ab48-c16253ffd609]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:46:48 user nova-compute[70709]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 (non-flash)
Jul 28 00:46:48 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d (non-flash)
Jul 28 00:46:48 user nova-compute[70709]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 (non-flash)
Jul 28 00:46:48 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b91dd2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d'): ({'sdc'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Removing single pathed devices sdc {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31fb56b-25ef-43f2-999c-a42123a393c4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa6bbbf-3367-4dea-bd44-ee0fef0b4965]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Flushing IO for device /dev/sdc {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[029dc947-ef85-447a-8478-9e1974fbebf5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bad034c-d297-4389-8784-fb79407656e7]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] SCSI volumes sdc have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ba40a532', '/dev/disk/by-id/scsi-1SCST_BIOba40a532-141e014289384a80', '/dev/disk/by-id/scsi-23134316530313432') {{(pid=82455) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[737d8f51-0f40-4b61-8c83-1662314c9a4b]: (4, None) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[278cbfbd-5d08-446a-86f9-f5f3682ab405]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:46:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b652af3f-039d-484a-b894-f07b4298653a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260]
Jul 28 00:46:49 user nova-compute[70709]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d, portal: 172.16.0.220,3260] successful.
Jul 28 00:46:49 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72444c3c-4a7e-43bf-b6f7-961f5301eb1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[550222f4-1ab9-407f-91ee-b95c2a35e72a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] <== disconnect_volume: return (314ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:46:49 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Deleting instance files /opt/stack/data/nova/instances/730e1d50-7320-4c5a-a57f-c5e7a2066a16_del
Jul 28 00:46:49 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Deletion of /opt/stack/data/nova/instances/730e1d50-7320-4c5a-a57f-c5e7a2066a16_del complete
Jul 28 00:46:49 user nova-compute[70709]: INFO nova.compute.manager [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:46:49 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Instance destroyed successfully.
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.objects.instance [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lazy-loading 'resources' on Instance uuid 4658dea2-f6e3-47db-8e37-97d64c70fe4c {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-112727453',display_name='tempest-SnapshotDataIntegrityTests-server-112727453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-112727453',id=45,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUDG6krpW8/YAljBawVWqsAhNlfZT3/ppckXM//SxebFynWqAYbE8xpGFLrxvAEdm2hcC31TWWTZqLO1yZRzQTyKnla3B3+M2xI4EJf9ejzlO1nEX7skLbhhZgxF3vDmg==',key_name='tempest-keypair-1021118189',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:39:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='578e5b0ed17745a188b54c44f426eca9',ramdisk_id='',reservation_id='r-3p9k3bjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2056239659',owner_user_name='tempest-SnapshotDataIntegrityTests-2056239659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:39:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e898b8e480e4d40a8e40beec39f2b66',uuid=4658dea2-f6e3-47db-8e37-97d64c70fe4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Converting VIF {"id": "0ee4a18f-b92b-4bff-930f-0815d6962257", "address": "fa:16:3e:01:51:d2", "network": {"id": "66d15025-063a-47d7-9a20-086bf8e56d60", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1727041450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "578e5b0ed17745a188b54c44f426eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee4a18f-b9", "ovs_interfaceid": "0ee4a18f-b92b-4bff-930f-0815d6962257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:51:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ee4a18f-b92b-4bff-930f-0815d6962257,network=Network(66d15025-063a-47d7-9a20-086bf8e56d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee4a18f-b9') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG os_vif [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:51:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ee4a18f-b92b-4bff-930f-0815d6962257,network=Network(66d15025-063a-47d7-9a20-086bf8e56d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee4a18f-b9') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ee4a18f-b9, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:46:49 user nova-compute[70709]: INFO os_vif [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:51:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ee4a18f-b92b-4bff-930f-0815d6962257,network=Network(66d15025-063a-47d7-9a20-086bf8e56d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee4a18f-b9')
Jul 28 00:46:49 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Deleting instance files /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c_del
Jul 28 00:46:49 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Deletion of /opt/stack/data/nova/instances/4658dea2-f6e3-47db-8e37-97d64c70fe4c_del complete
Jul 28 00:46:49 user nova-compute[70709]: INFO nova.compute.manager [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:46:49 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Took 0.53 seconds to deallocate network for instance.
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Received event network-vif-unplugged-0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] No waiting events found dispatching network-vif-unplugged-0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Received event network-vif-unplugged-0ee4a18f-b92b-4bff-930f-0815d6962257 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Received event network-vif-plugged-0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] Acquiring lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] No waiting events found dispatching network-vif-plugged-0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:46:49 user nova-compute[70709]: WARNING nova.compute.manager [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Received unexpected event network-vif-plugged-0ee4a18f-b92b-4bff-930f-0815d6962257 for instance with vm_state active and task_state deleting.
Jul 28 00:46:49 user nova-compute[70709]: DEBUG nova.compute.manager [req-2df7bda1-d134-40d6-8eb7-c748fa6cf870 req-f304dcc5-764d-4c04-a4a7-0bc73bbfacf7 service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received event network-vif-deleted-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-52c5a6ed-d2fa-49f5-ae35-84f09e28d1b0 req-9a33d122-169d-4be3-b746-79eea19a2ffd service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received event network-vif-plugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-52c5a6ed-d2fa-49f5-ae35-84f09e28d1b0 req-9a33d122-169d-4be3-b746-79eea19a2ffd service nova] Acquiring lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-52c5a6ed-d2fa-49f5-ae35-84f09e28d1b0 req-9a33d122-169d-4be3-b746-79eea19a2ffd service nova] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-52c5a6ed-d2fa-49f5-ae35-84f09e28d1b0 req-9a33d122-169d-4be3-b746-79eea19a2ffd service nova] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-52c5a6ed-d2fa-49f5-ae35-84f09e28d1b0 req-9a33d122-169d-4be3-b746-79eea19a2ffd service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] No waiting events found dispatching network-vif-plugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:46:50 user nova-compute[70709]: WARNING nova.compute.manager [req-52c5a6ed-d2fa-49f5-ae35-84f09e28d1b0 req-9a33d122-169d-4be3-b746-79eea19a2ffd service nova] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Received unexpected event network-vif-plugged-f15ef2c2-3c3f-45b3-b2a2-cc3ec157e575 for instance with vm_state active and task_state deleting.
Jul 28 00:46:50 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Took 1.02 seconds to deallocate network for instance.
Jul 28 00:46:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:50 user nova-compute[70709]: INFO nova.compute.manager [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Took 0.95 seconds to detach 1 volumes for instance.
Jul 28 00:46:50 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Deleted allocations for instance 4658dea2-f6e3-47db-8e37-97d64c70fe4c
Jul 28 00:46:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-91715587-f304-42b5-a0ab-759b82d820d1 tempest-SnapshotDataIntegrityTests-2056239659 tempest-SnapshotDataIntegrityTests-2056239659-project-member] Lock "4658dea2-f6e3-47db-8e37-97d64c70fe4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.312s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:46:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:50 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Deleted allocations for instance 730e1d50-7320-4c5a-a57f-c5e7a2066a16
Jul 28 00:46:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-d7e5ef1d-ff66-4e7e-9726-7935931f144a tempest-TestVolumeBootPattern-2090046407 tempest-TestVolumeBootPattern-2090046407-project-member] Lock "730e1d50-7320-4c5a-a57f-c5e7a2066a16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.059s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:46:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-4cc541e4-6479-44a8-9e04-704c443d6536 req-cc383180-116c-4c3d-a76d-de10d4f46452 service nova] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Received event network-vif-deleted-0ee4a18f-b92b-4bff-930f-0815d6962257 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:46:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:46:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:03 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690505208.671377, 730e1d50-7320-4c5a-a57f-c5e7a2066a16 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:47:03 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] VM Stopped (Lifecycle Event)
Jul 28 00:47:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-21f46efa-6fa0-474b-8ee6-deca89852766 None None] [instance: 730e1d50-7320-4c5a-a57f-c5e7a2066a16] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:47:04 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690505209.1656013, 4658dea2-f6e3-47db-8e37-97d64c70fe4c => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:47:04 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] VM Stopped (Lifecycle Event)
Jul 28 00:47:04 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9761d7f8-b9fb-48a1-9eaa-2dd422427e1e None None] [instance: 4658dea2-f6e3-47db-8e37-97d64c70fe4c] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:47:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:47:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:47:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:47:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:47:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:47:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:47:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:47:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:47:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:47:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:47:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:47:33 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:47:33 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:47:33 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:47:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:47:35 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:47:35 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:47:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8597MB free_disk=25.211990356445312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance d76e49c9-7dc6-444f-a347-2ab782f56144 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:47:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:47:36 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:47:36 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:47:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:47:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:47:37 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:47:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:41 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:47:42 user nova-compute[70709]: INFO nova.compute.manager [None req-92436cba-6b40-4d33-97d8-458b8154b2e0 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Unrescuing
Jul 28 00:47:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-92436cba-6b40-4d33-97d8-458b8154b2e0 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:47:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-92436cba-6b40-4d33-97d8-458b8154b2e0 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquired lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:47:42 user nova-compute[70709]: DEBUG nova.network.neutron [None req-92436cba-6b40-4d33-97d8-458b8154b2e0 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG nova.network.neutron [None req-92436cba-6b40-4d33-97d8-458b8154b2e0 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updating instance_info_cache with network_info: [{"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-92436cba-6b40-4d33-97d8-458b8154b2e0 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Releasing lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG nova.objects.instance [None req-92436cba-6b40-4d33-97d8-458b8154b2e0 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'flavor' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-d19277f6-0ec9-4f5f-b8be-1b187c3f39bc req-6fd36e08-6036-41a9-bb5e-c2562af89aa5 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-unplugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d19277f6-0ec9-4f5f-b8be-1b187c3f39bc req-6fd36e08-6036-41a9-bb5e-c2562af89aa5 service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d19277f6-0ec9-4f5f-b8be-1b187c3f39bc req-6fd36e08-6036-41a9-bb5e-c2562af89aa5 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-d19277f6-0ec9-4f5f-b8be-1b187c3f39bc req-6fd36e08-6036-41a9-bb5e-c2562af89aa5 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:47:43 user nova-compute[70709]: DEBUG nova.compute.manager [req-d19277f6-0ec9-4f5f-b8be-1b187c3f39bc req-6fd36e08-6036-41a9-bb5e-c2562af89aa5 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-unplugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:47:43 user nova-compute[70709]: WARNING nova.compute.manager [req-d19277f6-0ec9-4f5f-b8be-1b187c3f39bc req-6fd36e08-6036-41a9-bb5e-c2562af89aa5 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received unexpected event network-vif-unplugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:47:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:44 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Instance destroyed successfully.
Jul 28 00:47:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-a570f862-b30c-41b3-92f4-b87c5361ca8e req-a102c4c5-c8dc-4117-a8b4-ea915f45a74c service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:47:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a570f862-b30c-41b3-92f4-b87c5361ca8e req-a102c4c5-c8dc-4117-a8b4-ea915f45a74c service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:47:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a570f862-b30c-41b3-92f4-b87c5361ca8e req-a102c4c5-c8dc-4117-a8b4-ea915f45a74c service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:47:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a570f862-b30c-41b3-92f4-b87c5361ca8e req-a102c4c5-c8dc-4117-a8b4-ea915f45a74c service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:47:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-a570f862-b30c-41b3-92f4-b87c5361ca8e req-a102c4c5-c8dc-4117-a8b4-ea915f45a74c service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:47:46 user nova-compute[70709]: WARNING nova.compute.manager [req-a570f862-b30c-41b3-92f4-b87c5361ca8e req-a102c4c5-c8dc-4117-a8b4-ea915f45a74c service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received unexpected event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with vm_state rescued and task_state unrescuing.
Jul 28 00:47:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:47 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Removed pending event for d76e49c9-7dc6-444f-a347-2ab782f56144 due to event {{(pid=70709) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 28 00:47:47 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505267.6981676, d76e49c9-7dc6-444f-a347-2ab782f56144 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:47:47 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] VM Resumed (Lifecycle Event)
Jul 28 00:47:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-92436cba-6b40-4d33-97d8-458b8154b2e0 tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:47:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:47:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:47:47 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 28 00:47:47 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505267.6995618, d76e49c9-7dc6-444f-a347-2ab782f56144 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:47:47 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] VM Started (Lifecycle Event)
Jul 28 00:47:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:47:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:47:47 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:47:48 user nova-compute[70709]: WARNING nova.compute.manager [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received unexpected event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with vm_state active and task_state None.
Jul 28 00:47:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:47:48 user nova-compute[70709]: WARNING nova.compute.manager [req-f4e09fa9-65d7-4419-86e4-5a118bc7e2be req-643b90ff-a9cd-46b1-8538-163a44fd5f61 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received unexpected event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with vm_state active and task_state None.
Jul 28 00:47:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:47:48 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:47:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:49 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updating instance_info_cache with network_info: [{"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:47:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:47:49 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:47:49 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:47:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:47:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:48:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:48:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:48:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:48:36 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:48:36 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:48:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8702MB free_disk=25.200592041015625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance d76e49c9-7dc6-444f-a347-2ab782f56144 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:48:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:48:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:48:37 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:48:38 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:48:38 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:48:38 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:48:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:48:41 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:48:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:48:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:48:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:48:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:48:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:47 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:48:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:48:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:49 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:48:50 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:48:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:48:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:48:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:48:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:48:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:48:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:48:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:48:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:49:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:49:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:49:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:49:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:49:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:49:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:49:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:49:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:49:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG nova.compute.manager [req-89fc29fe-106d-4282-8b9b-6e07042dde70 req-3bd48172-31a9-49f9-9717-7df8982b4ca5 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-changed-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG nova.compute.manager [req-89fc29fe-106d-4282-8b9b-6e07042dde70 req-3bd48172-31a9-49f9-9717-7df8982b4ca5 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Refreshing instance network info cache due to event network-changed-0ca782ea-ee7e-4a72-8830-8aa6194b072c. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-89fc29fe-106d-4282-8b9b-6e07042dde70 req-3bd48172-31a9-49f9-9717-7df8982b4ca5 service nova] Acquiring lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-89fc29fe-106d-4282-8b9b-6e07042dde70 req-3bd48172-31a9-49f9-9717-7df8982b4ca5 service nova] Acquired lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG nova.network.neutron [req-89fc29fe-106d-4282-8b9b-6e07042dde70 req-3bd48172-31a9-49f9-9717-7df8982b4ca5 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Refreshing network info cache for port 0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:49:34 user nova-compute[70709]: INFO nova.compute.manager [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Detaching volume f672fd95-8126-42b2-bf2a-2528506698b9
Jul 28 00:49:34 user nova-compute[70709]: INFO nova.virt.block_device [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Attempting to driver detach volume f672fd95-8126-42b2-bf2a-2528506698b9 from mountpoint /dev/vdb
Jul 28 00:49:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Attempting to detach device vdb from instance d76e49c9-7dc6-444f-a347-2ab782f56144 from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:49:34 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:49:34 user nova-compute[70709]:   <source dev="/dev/sdb"/>
Jul 28 00:49:34 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:49:34 user nova-compute[70709]:   <serial>f672fd95-8126-42b2-bf2a-2528506698b9</serial>
Jul 28 00:49:34 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:49:34 user nova-compute[70709]: </disk>
Jul 28 00:49:34 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:49:34 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Successfully detached device vdb from instance d76e49c9-7dc6-444f-a347-2ab782f56144 from the persistent domain config.
Jul 28 00:49:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d76e49c9-7dc6-444f-a347-2ab782f56144 from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:49:34 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:49:34 user nova-compute[70709]:   <source dev="/dev/sdb"/>
Jul 28 00:49:34 user nova-compute[70709]:   <target dev="vdb" bus="virtio"/>
Jul 28 00:49:34 user nova-compute[70709]:   <serial>f672fd95-8126-42b2-bf2a-2528506698b9</serial>
Jul 28 00:49:34 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 28 00:49:34 user nova-compute[70709]: </disk>
Jul 28 00:49:34 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG nova.network.neutron [req-89fc29fe-106d-4282-8b9b-6e07042dde70 req-3bd48172-31a9-49f9-9717-7df8982b4ca5 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updated VIF entry in instance network info cache for port 0ca782ea-ee7e-4a72-8830-8aa6194b072c. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG nova.network.neutron [req-89fc29fe-106d-4282-8b9b-6e07042dde70 req-3bd48172-31a9-49f9-9717-7df8982b4ca5 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updating instance_info_cache with network_info: [{"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-89fc29fe-106d-4282-8b9b-6e07042dde70 req-3bd48172-31a9-49f9-9717-7df8982b4ca5 service nova] Releasing lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:49:34 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690505375.076288, d76e49c9-7dc6-444f-a347-2ab782f56144 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:49:35 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Successfully detached device vdb from instance d76e49c9-7dc6-444f-a347-2ab782f56144 from the live domain config.
Jul 28 00:49:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQlJGqkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:49:35 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db63bc-657d-4f59-9d96-892bfe196b94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:49:35 user nova-compute[70709]: No targets found.
Jul 28 00:49:35 user nova-compute[70709]: iSNS:
Jul 28 00:49:35 user nova-compute[70709]: No targets found.
Jul 28 00:49:35 user nova-compute[70709]: STATIC:
Jul 28 00:49:35 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9
Jul 28 00:49:35 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:49:35 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:49:35 user nova-compute[70709]: FIRMWARE:
Jul 28 00:49:35 user nova-compute[70709]: No targets found.
Jul 28 00:49:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:49:35 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:49:35 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccccc9ad-e19b-4239-8e0e-66a39d8ccbe1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b26023-69d2-4607-970a-4bba7b8b0568]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 (non-flash)
Jul 28 00:49:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 (non-flash)
Jul 28 00:49:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b906e9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9'): ({'sdb'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Removing single pathed devices sdb {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c25f80b-7adb-47f6-912b-9bfd00a6b9b8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3a987b-9ecd-4846-9997-68a792e2eed9]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Flushing IO for device /dev/sdb {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2833f567-aea3-47a3-857e-07e8a37517ff]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af317de-c4a9-4d72-a2e2-db3480cf6356]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2482184-24ed-439d-962f-51d8e13986b1]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f0d30a-3a5b-4e74-b158-eec1638a5589]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9, portal: 172.16.0.220,3260]
Jul 28 00:49:35 user nova-compute[70709]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9, portal: 172.16.0.220,3260] successful.
Jul 28 00:49:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f672fd95-8126-42b2-bf2a-2528506698b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe61a250-059a-4b23-83b8-9cd845c8315e]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] <== disconnect_volume: return (340ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.objects.instance [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'flavor' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-858c1de7-c7c0-4454-ad40-a48aa301566d tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.729s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-f3a2d631-e716-4fa2-aa00-60843beacb4b req-bf6f8013-0258-4a57-8b7e-d25e3734c44d service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-changed-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-f3a2d631-e716-4fa2-aa00-60843beacb4b req-bf6f8013-0258-4a57-8b7e-d25e3734c44d service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Refreshing instance network info cache due to event network-changed-0ca782ea-ee7e-4a72-8830-8aa6194b072c. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f3a2d631-e716-4fa2-aa00-60843beacb4b req-bf6f8013-0258-4a57-8b7e-d25e3734c44d service nova] Acquiring lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f3a2d631-e716-4fa2-aa00-60843beacb4b req-bf6f8013-0258-4a57-8b7e-d25e3734c44d service nova] Acquired lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.network.neutron [req-f3a2d631-e716-4fa2-aa00-60843beacb4b req-bf6f8013-0258-4a57-8b7e-d25e3734c44d service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Refreshing network info cache for port 0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:49:36 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:49:36 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=25.199871063232422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance d76e49c9-7dc6-444f-a347-2ab782f56144 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:49:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:49:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-f3a2d631-e716-4fa2-aa00-60843beacb4b req-bf6f8013-0258-4a57-8b7e-d25e3734c44d service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updated VIF entry in instance network info cache for port 0ca782ea-ee7e-4a72-8830-8aa6194b072c. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:49:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-f3a2d631-e716-4fa2-aa00-60843beacb4b req-bf6f8013-0258-4a57-8b7e-d25e3734c44d service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updating instance_info_cache with network_info: [{"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:49:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f3a2d631-e716-4fa2-aa00-60843beacb4b req-bf6f8013-0258-4a57-8b7e-d25e3734c44d service nova] Releasing lock "refresh_cache-d76e49c9-7dc6-444f-a347-2ab782f56144" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:49:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:49:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:49:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:49:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:49:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:49:43 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:49:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:49:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:49:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:49:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:49:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:49:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:47 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:49:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:51 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:49:52 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:49:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:49:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:49:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:49:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:49:53 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:49:53 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:49:53 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updating instance_info_cache with network_info: [{"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:49:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-96099a70-86f0-4f81-877a-2f30c8c126f8" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:49:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:49:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:49:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:49:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:49:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:49:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:49:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Verify base images {{(pid=70709) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Image id 51efbb04-1b4c-43c9-99e8-6467b05b27ad yields fingerprint 735092a584d39faa236d7ec43c68916467bd8025 {{(pid=70709) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 28 00:50:06 user nova-compute[70709]: INFO nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] image 51efbb04-1b4c-43c9-99e8-6467b05b27ad at (/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025): checking
Jul 28 00:50:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] image 51efbb04-1b4c-43c9-99e8-6467b05b27ad at (/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025): image is in use {{(pid=70709) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=70709) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] 4d016cd1-fe5e-4ec9-9105-5450d99c9599 is a valid instance name {{(pid=70709) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] 4d016cd1-fe5e-4ec9-9105-5450d99c9599 has a disk file {{(pid=70709) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 28 00:50:06 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 is backed by 735092a584d39faa236d7ec43c68916467bd8025 {{(pid=70709) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] 96099a70-86f0-4f81-877a-2f30c8c126f8 is a valid instance name {{(pid=70709) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] 96099a70-86f0-4f81-877a-2f30c8c126f8 has a disk file {{(pid=70709) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 is backed by 735092a584d39faa236d7ec43c68916467bd8025 {{(pid=70709) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] d76e49c9-7dc6-444f-a347-2ab782f56144 is a valid instance name {{(pid=70709) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] d76e49c9-7dc6-444f-a347-2ab782f56144 has a disk file {{(pid=70709) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance d76e49c9-7dc6-444f-a347-2ab782f56144 is backed by 735092a584d39faa236d7ec43c68916467bd8025 {{(pid=70709) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 28 00:50:07 user nova-compute[70709]: WARNING nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f
Jul 28 00:50:07 user nova-compute[70709]: WARNING nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2
Jul 28 00:50:07 user nova-compute[70709]: WARNING nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806
Jul 28 00:50:07 user nova-compute[70709]: WARNING nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee
Jul 28 00:50:07 user nova-compute[70709]: WARNING nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42
Jul 28 00:50:07 user nova-compute[70709]: WARNING nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb
Jul 28 00:50:07 user nova-compute[70709]: WARNING nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a
Jul 28 00:50:07 user nova-compute[70709]: INFO nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Active base files: /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025
Jul 28 00:50:07 user nova-compute[70709]: INFO nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Removable base files: /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2 /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806 /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42 /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a
Jul 28 00:50:07 user nova-compute[70709]: INFO nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/156fd4e3962f8ba6de305b9dbb92460ef49b5a5f
Jul 28 00:50:07 user nova-compute[70709]: INFO nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/360fca81b925d04bd63a6e6b8afe4a768cf785d2
Jul 28 00:50:07 user nova-compute[70709]: INFO nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/89bafd29161ecab7af8b5b559be2e4b0a66b6806
Jul 28 00:50:07 user nova-compute[70709]: INFO nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9acaf5ccf3411b61d5765e9e596faddf3c91dcee
Jul 28 00:50:07 user nova-compute[70709]: INFO nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0336f29a99fca21c521c0131f551e2cc3425bd42
Jul 28 00:50:07 user nova-compute[70709]: INFO nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/401c34d740ce477f8426b9e3eb8e9919c1ddb5bb
Jul 28 00:50:07 user nova-compute[70709]: INFO nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e84a4becce58e5376ed2db9ab77c606f376a1c3a
Jul 28 00:50:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Verification complete {{(pid=70709) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Verify swap images {{(pid=70709) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 28 00:50:07 user nova-compute[70709]: DEBUG nova.virt.libvirt.imagecache [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Verify ephemeral images {{(pid=70709) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 28 00:50:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:50:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:50:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:50:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:50:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:50:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:50:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:50:24 user nova-compute[70709]: INFO nova.compute.manager [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Terminating instance
Jul 28 00:50:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:50:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-3b3b017b-b19e-41bf-9916-2bb0b19231d6 req-80b44626-54ae-4cf8-a1fd-67a03b0b9d1a service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-unplugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3b3b017b-b19e-41bf-9916-2bb0b19231d6 req-80b44626-54ae-4cf8-a1fd-67a03b0b9d1a service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3b3b017b-b19e-41bf-9916-2bb0b19231d6 req-80b44626-54ae-4cf8-a1fd-67a03b0b9d1a service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3b3b017b-b19e-41bf-9916-2bb0b19231d6 req-80b44626-54ae-4cf8-a1fd-67a03b0b9d1a service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-3b3b017b-b19e-41bf-9916-2bb0b19231d6 req-80b44626-54ae-4cf8-a1fd-67a03b0b9d1a service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-unplugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-3b3b017b-b19e-41bf-9916-2bb0b19231d6 req-80b44626-54ae-4cf8-a1fd-67a03b0b9d1a service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-unplugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:50:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Instance destroyed successfully.
Jul 28 00:50:25 user nova-compute[70709]: DEBUG nova.objects.instance [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'resources' on Instance uuid d76e49c9-7dc6-444f-a347-2ab782f56144 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2129512621',display_name='tempest-ServerRescueNegativeTestJSON-server-2129512621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2129512621',id=47,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIkjUZ8Ct3mkPHoB8VEfjyVbahhtK6LD1UExufiyJWkyxpLp3IwdHejllwZCdIwOmmIqSZgxaTPuNXf8aWJu+qgQFjbX6HpxP3hRRLTjKq+Pqfkh4kCGjRFHm0qQCv1pg==',key_name='tempest-keypair-2132315906',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:45:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-xdxw3fk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8afed76354148e290f0b4f602616818',uuid=d76e49c9-7dc6-444f-a347-2ab782f56144,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "address": "fa:16:3e:75:a1:0a", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca782ea-ee", "ovs_interfaceid": "0ca782ea-ee7e-4a72-8830-8aa6194b072c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=0ca782ea-ee7e-4a72-8830-8aa6194b072c,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca782ea-ee') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG os_vif [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=0ca782ea-ee7e-4a72-8830-8aa6194b072c,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca782ea-ee') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ca782ea-ee, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:50:25 user nova-compute[70709]: INFO os_vif [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=0ca782ea-ee7e-4a72-8830-8aa6194b072c,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca782ea-ee')
Jul 28 00:50:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Deleting instance files /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144_del
Jul 28 00:50:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Deletion of /opt/stack/data/nova/instances/d76e49c9-7dc6-444f-a347-2ab782f56144_del complete
Jul 28 00:50:25 user nova-compute[70709]: INFO nova.compute.manager [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 28 00:50:25 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:50:25 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:50:26 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:50:26 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Took 0.81 seconds to deallocate network for instance.
Jul 28 00:50:26 user nova-compute[70709]: DEBUG nova.compute.manager [req-2955165e-972a-4176-bf2e-afe0f2086fc7 req-bc2f4fe0-f487-40ec-8e7c-ccf7853c7e0f service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-deleted-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:50:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:50:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:50:26 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:50:26 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:50:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:50:26 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Deleted allocations for instance d76e49c9-7dc6-444f-a347-2ab782f56144
Jul 28 00:50:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-57ef7787-5c8f-450d-bcbb-f88bbd8e2afc tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.043s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:50:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-041cc9e7-a000-463a-8d83-b32fc43b76d0 req-44d00375-f61c-4f42-8eaf-439949adb8e7 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:50:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-041cc9e7-a000-463a-8d83-b32fc43b76d0 req-44d00375-f61c-4f42-8eaf-439949adb8e7 service nova] Acquiring lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:50:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-041cc9e7-a000-463a-8d83-b32fc43b76d0 req-44d00375-f61c-4f42-8eaf-439949adb8e7 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:50:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-041cc9e7-a000-463a-8d83-b32fc43b76d0 req-44d00375-f61c-4f42-8eaf-439949adb8e7 service nova] Lock "d76e49c9-7dc6-444f-a347-2ab782f56144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:50:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-041cc9e7-a000-463a-8d83-b32fc43b76d0 req-44d00375-f61c-4f42-8eaf-439949adb8e7 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] No waiting events found dispatching network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:50:27 user nova-compute[70709]: WARNING nova.compute.manager [req-041cc9e7-a000-463a-8d83-b32fc43b76d0 req-44d00375-f61c-4f42-8eaf-439949adb8e7 service nova] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Received unexpected event network-vif-plugged-0ca782ea-ee7e-4a72-8830-8aa6194b072c for instance with vm_state deleted and task_state None.
Jul 28 00:50:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:50:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:50:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:50:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:50:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:50:36 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:50:36 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:50:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=25.227123260498047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:50:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:50:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:50:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:50:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:50:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:50:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:50:37 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:50:37 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:50:37 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:50:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:50:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:40 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690505425.6794426, d76e49c9-7dc6-444f-a347-2ab782f56144 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:50:40 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] VM Stopped (Lifecycle Event)
Jul 28 00:50:40 user nova-compute[70709]: DEBUG nova.compute.manager [None req-b5b59041-ebe5-49cb-8986-eb77660f7fa9 None None] [instance: d76e49c9-7dc6-444f-a347-2ab782f56144] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:50:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:50:40 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:41 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:50:44 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:50:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 4d016cd1-fe5e-4ec9-9105-5450d99c9599 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 00:50:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:50:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:50:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:50:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:50:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:50:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:50:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:50:47 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:50 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:52 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:50:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:50:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:50:52 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:50:53 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updating instance_info_cache with network_info: [{"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:50:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-4d016cd1-fe5e-4ec9-9105-5450d99c9599" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:50:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:50:53 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:53 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:50:53 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 00:50:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:50:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:50:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:50:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:50:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:50:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:04 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:51:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:51:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:51:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:51:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:51:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:51:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:51:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 00:51:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 00:51:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:51:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:51:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:51:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:51:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:51:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:51:27 user nova-compute[70709]: INFO nova.compute.manager [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Terminating instance
Jul 28 00:51:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-3a32ad39-89a6-4a06-bb7a-961dafa6553b req-3dcb979f-be97-45b0-b64a-c5638de3a5da service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received event network-vif-unplugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3a32ad39-89a6-4a06-bb7a-961dafa6553b req-3dcb979f-be97-45b0-b64a-c5638de3a5da service nova] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3a32ad39-89a6-4a06-bb7a-961dafa6553b req-3dcb979f-be97-45b0-b64a-c5638de3a5da service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3a32ad39-89a6-4a06-bb7a-961dafa6553b req-3dcb979f-be97-45b0-b64a-c5638de3a5da service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-3a32ad39-89a6-4a06-bb7a-961dafa6553b req-3dcb979f-be97-45b0-b64a-c5638de3a5da service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] No waiting events found dispatching network-vif-unplugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-3a32ad39-89a6-4a06-bb7a-961dafa6553b req-3dcb979f-be97-45b0-b64a-c5638de3a5da service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received event network-vif-unplugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:51:27 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Instance destroyed successfully.
Jul 28 00:51:27 user nova-compute[70709]: DEBUG nova.objects.instance [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'resources' on Instance uuid 4d016cd1-fe5e-4ec9-9105-5450d99c9599 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1655829224',display_name='tempest-ServerRescueNegativeTestJSON-server-1655829224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1655829224',id=41,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:37:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-iqt1ls02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:37:07Z,user_data=None,user_id='d8afed76354148e290f0b4f602616818',uuid=4d016cd1-fe5e-4ec9-9105-5450d99c9599,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "address": "fa:16:3e:d5:7d:fd", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae9215-f0", "ovs_interfaceid": "d9ae9215-f02d-4969-ba43-f7ae789ad860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:7d:fd,bridge_name='br-int',has_traffic_filtering=True,id=d9ae9215-f02d-4969-ba43-f7ae789ad860,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae9215-f0') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG os_vif [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:7d:fd,bridge_name='br-int',has_traffic_filtering=True,id=d9ae9215-f02d-4969-ba43-f7ae789ad860,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae9215-f0') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9ae9215-f0, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:27 user nova-compute[70709]: INFO os_vif [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:7d:fd,bridge_name='br-int',has_traffic_filtering=True,id=d9ae9215-f02d-4969-ba43-f7ae789ad860,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae9215-f0')
Jul 28 00:51:27 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Deleting instance files /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599_del
Jul 28 00:51:27 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Deletion of /opt/stack/data/nova/instances/4d016cd1-fe5e-4ec9-9105-5450d99c9599_del complete
Jul 28 00:51:28 user nova-compute[70709]: INFO nova.compute.manager [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 28 00:51:28 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:51:28 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:51:28 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:51:28 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:51:28 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Took 0.96 seconds to deallocate network for instance.
Jul 28 00:51:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-44976add-0399-4166-90b8-bd1a33a0b939 req-85cd1865-4ef0-46c5-abcf-631baf57fb69 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received event network-vif-deleted-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:51:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:51:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:51:29 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:51:29 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:51:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:51:29 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Deleted allocations for instance 4d016cd1-fe5e-4ec9-9105-5450d99c9599
Jul 28 00:51:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-8af41730-1475-4545-b12a-85d6128e961c tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:51:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-b289459f-f739-4dcb-ab03-375b63928c31 req-a59a69b8-24f6-4825-b6b6-90feed0b92f3 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:51:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b289459f-f739-4dcb-ab03-375b63928c31 req-a59a69b8-24f6-4825-b6b6-90feed0b92f3 service nova] Acquiring lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:51:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b289459f-f739-4dcb-ab03-375b63928c31 req-a59a69b8-24f6-4825-b6b6-90feed0b92f3 service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:51:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b289459f-f739-4dcb-ab03-375b63928c31 req-a59a69b8-24f6-4825-b6b6-90feed0b92f3 service nova] Lock "4d016cd1-fe5e-4ec9-9105-5450d99c9599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:51:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-b289459f-f739-4dcb-ab03-375b63928c31 req-a59a69b8-24f6-4825-b6b6-90feed0b92f3 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] No waiting events found dispatching network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:51:29 user nova-compute[70709]: WARNING nova.compute.manager [req-b289459f-f739-4dcb-ab03-375b63928c31 req-a59a69b8-24f6-4825-b6b6-90feed0b92f3 service nova] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Received unexpected event network-vif-plugged-d9ae9215-f02d-4969-ba43-f7ae789ad860 for instance with vm_state deleted and task_state None.
Jul 28 00:51:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:36 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:51:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:51:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:51:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:51:36 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:51:36 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:51:37 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:51:37 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:51:37 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=25.25440216064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:51:37 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:51:38 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:51:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:51:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:51:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:51:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:51:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:51:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:51:42 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690505487.9111784, 4d016cd1-fe5e-4ec9-9105-5450d99c9599 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:51:42 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] VM Stopped (Lifecycle Event)
Jul 28 00:51:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-5c16cdc5-d715-4b96-9eff-f95a19be1092 None None] [instance: 4d016cd1-fe5e-4ec9-9105-5450d99c9599] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:51:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:51:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:51:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:51:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:51:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:46 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:51:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:51:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:51:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:51:53 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:51:54 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:51:54 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:51:54 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:51:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:52:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:52:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:52:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:52:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:52:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:52:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:52:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:52:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:52:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:52:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:52:17 user nova-compute[70709]: INFO nova.compute.manager [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Terminating instance
Jul 28 00:52:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:52:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-41e9d758-488b-437d-baea-9a0be5b11d66 req-b2ff7054-97f4-4716-848b-5aba1af09d3d service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-unplugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41e9d758-488b-437d-baea-9a0be5b11d66 req-b2ff7054-97f4-4716-848b-5aba1af09d3d service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41e9d758-488b-437d-baea-9a0be5b11d66 req-b2ff7054-97f4-4716-848b-5aba1af09d3d service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-41e9d758-488b-437d-baea-9a0be5b11d66 req-b2ff7054-97f4-4716-848b-5aba1af09d3d service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-41e9d758-488b-437d-baea-9a0be5b11d66 req-b2ff7054-97f4-4716-848b-5aba1af09d3d service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-unplugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG nova.compute.manager [req-41e9d758-488b-437d-baea-9a0be5b11d66 req-b2ff7054-97f4-4716-848b-5aba1af09d3d service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-unplugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Instance destroyed successfully.
Jul 28 00:52:18 user nova-compute[70709]: DEBUG nova.objects.instance [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lazy-loading 'resources' on Instance uuid 96099a70-86f0-4f81-877a-2f30c8c126f8 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2111279381',display_name='tempest-ServerRescueNegativeTestJSON-server-2111279381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2111279381',id=40,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:40:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad38eeba09ce4551899f892ea787ea1c',ramdisk_id='',reservation_id='r-8jk89xcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1040689578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1040689578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:41:53Z,user_data=None,user_id='d8afed76354148e290f0b4f602616818',uuid=96099a70-86f0-4f81-877a-2f30c8c126f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converting VIF {"id": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "address": "fa:16:3e:b6:9c:31", "network": {"id": "edc76181-ad12-4a2f-a271-6ad13e6887ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-330737996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad38eeba09ce4551899f892ea787ea1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b266b04-62", "ovs_interfaceid": "2b266b04-6203-458a-b727-e7f2e4ab00a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9c:31,bridge_name='br-int',has_traffic_filtering=True,id=2b266b04-6203-458a-b727-e7f2e4ab00a7,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b266b04-62') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG os_vif [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9c:31,bridge_name='br-int',has_traffic_filtering=True,id=2b266b04-6203-458a-b727-e7f2e4ab00a7,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b266b04-62') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b266b04-62, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:52:18 user nova-compute[70709]: INFO os_vif [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9c:31,bridge_name='br-int',has_traffic_filtering=True,id=2b266b04-6203-458a-b727-e7f2e4ab00a7,network=Network(edc76181-ad12-4a2f-a271-6ad13e6887ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b266b04-62')
Jul 28 00:52:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Deleting instance files /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8_del
Jul 28 00:52:18 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Deletion of /opt/stack/data/nova/instances/96099a70-86f0-4f81-877a-2f30c8c126f8_del complete
Jul 28 00:52:18 user nova-compute[70709]: INFO nova.compute.manager [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 28 00:52:18 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:52:18 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:52:19 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:52:19 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Took 0.49 seconds to deallocate network for instance.
Jul 28 00:52:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-a744385e-3bc6-452f-ada2-3b04435aa3bd req-d8a86c28-7515-498e-8792-24a2881c9aa6 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-deleted-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:52:19 user nova-compute[70709]: INFO nova.compute.manager [req-a744385e-3bc6-452f-ada2-3b04435aa3bd req-d8a86c28-7515-498e-8792-24a2881c9aa6 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Neutron deleted interface 2b266b04-6203-458a-b727-e7f2e4ab00a7; detaching it from the instance and deleting it from the info cache
Jul 28 00:52:19 user nova-compute[70709]: DEBUG nova.network.neutron [req-a744385e-3bc6-452f-ada2-3b04435aa3bd req-d8a86c28-7515-498e-8792-24a2881c9aa6 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:52:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-a744385e-3bc6-452f-ada2-3b04435aa3bd req-d8a86c28-7515-498e-8792-24a2881c9aa6 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Detach interface failed, port_id=2b266b04-6203-458a-b727-e7f2e4ab00a7, reason: Instance 96099a70-86f0-4f81-877a-2f30c8c126f8 could not be found. {{(pid=70709) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 28 00:52:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:52:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:52:19 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:52:19 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:52:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:52:19 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Deleted allocations for instance 96099a70-86f0-4f81-877a-2f30c8c126f8
Jul 28 00:52:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-97deff4f-c504-4cb8-bb0e-e8a54b074cfd tempest-ServerRescueNegativeTestJSON-1040689578 tempest-ServerRescueNegativeTestJSON-1040689578-project-member] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.665s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:52:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-8af99ecd-856d-42c0-8fff-77b2940ad9ee req-cb4cb55e-a59d-4e97-aba0-07b768d181b9 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:52:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8af99ecd-856d-42c0-8fff-77b2940ad9ee req-cb4cb55e-a59d-4e97-aba0-07b768d181b9 service nova] Acquiring lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:52:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8af99ecd-856d-42c0-8fff-77b2940ad9ee req-cb4cb55e-a59d-4e97-aba0-07b768d181b9 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:52:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8af99ecd-856d-42c0-8fff-77b2940ad9ee req-cb4cb55e-a59d-4e97-aba0-07b768d181b9 service nova] Lock "96099a70-86f0-4f81-877a-2f30c8c126f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:52:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-8af99ecd-856d-42c0-8fff-77b2940ad9ee req-cb4cb55e-a59d-4e97-aba0-07b768d181b9 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] No waiting events found dispatching network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:52:20 user nova-compute[70709]: WARNING nova.compute.manager [req-8af99ecd-856d-42c0-8fff-77b2940ad9ee req-cb4cb55e-a59d-4e97-aba0-07b768d181b9 service nova] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Received unexpected event network-vif-plugged-2b266b04-6203-458a-b727-e7f2e4ab00a7 for instance with vm_state deleted and task_state None.
Jul 28 00:52:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:33 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690505538.606186, 96099a70-86f0-4f81-877a-2f30c8c126f8 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:52:33 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] VM Stopped (Lifecycle Event)
Jul 28 00:52:33 user nova-compute[70709]: DEBUG nova.compute.manager [None req-78a98ed6-2969-40d8-82bf-e9954a77d351 None None] [instance: 96099a70-86f0-4f81-877a-2f30c8c126f8] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:52:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:52:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:52:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:52:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:52:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:38 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:52:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:52:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:52:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:52:38 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:52:39 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:52:39 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:52:39 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=25.2818603515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:52:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:52:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:52:39 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:52:39 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:52:39 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:52:39 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:52:39 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:52:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:52:41 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:52:41 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:52:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:52:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:52:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:52:43 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:52:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:52:49 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:52:52 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:52:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:52:54 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:52:54 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:52:54 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:52:54 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:52:55 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:52:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:53:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:53:23 user nova-compute[70709]: INFO nova.compute.claims [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Claim successful on node user
Jul 28 00:53:23 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 00:53:23 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 00:53:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG nova.policy [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bef098a320ff4116b6ea7cb12d6aa41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be36b20189ca4ac5880e2404b59f20dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:53:23 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Creating image(s)
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "/opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "/opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "/opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.129s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.128s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:53:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk 1073741824" returned: 0 in 0.048s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.129s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Successfully created port: 6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Cannot resize image /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'migration_context' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Ensure instance console log exists: /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:53:24 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Successfully updated port: 6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquired lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-83ae604c-3acb-4b24-b6ec-8669fb76f7f0 req-a56d6047-0383-4920-aa8f-e7b9794a0737 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-changed-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.compute.manager [req-83ae604c-3acb-4b24-b6ec-8669fb76f7f0 req-a56d6047-0383-4920-aa8f-e7b9794a0737 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Refreshing instance network info cache due to event network-changed-6baec140-9c13-4795-94e7-19992ffba645. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-83ae604c-3acb-4b24-b6ec-8669fb76f7f0 req-a56d6047-0383-4920-aa8f-e7b9794a0737 service nova] Acquiring lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Releasing lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Instance network_info: |[{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-83ae604c-3acb-4b24-b6ec-8669fb76f7f0 req-a56d6047-0383-4920-aa8f-e7b9794a0737 service nova] Acquired lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.network.neutron [req-83ae604c-3acb-4b24-b6ec-8669fb76f7f0 req-a56d6047-0383-4920-aa8f-e7b9794a0737 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Refreshing network info cache for port 6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Start _get_guest_xml network_info=[{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:53:25 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:53:25 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620221260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620221260',id=49,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQucKfe6jIWE1eH7EoKoLkvCwj1BrAVMLYkVE8VU2PBF/S85mzI+jJTXyZ0aTHz8dM/okRzJ1/AVwE1jb+X9/G1I1IKxShrc2+6uWDJeTPWV8nqu6eavluWn/ZOdfcu9Q==',key_name='tempest-keypair-405379372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-2ac8q871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=6dd25a67-f89b-48fb-972a-4d1098a2418e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:53:25 user nova-compute[70709]:   <uuid>6dd25a67-f89b-48fb-972a-4d1098a2418e</uuid>
Jul 28 00:53:25 user nova-compute[70709]:   <name>instance-00000031</name>
Jul 28 00:53:25 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:53:25 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:53:25 user nova-compute[70709]:   <metadata>
Jul 28 00:53:25 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:53:25 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:53:25 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-620221260</nova:name>
Jul 28 00:53:25 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:53:25</nova:creationTime>
Jul 28 00:53:25 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:53:25 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:53:25 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:53:25 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:53:25 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:53:25 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:53:25 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:53:25 user nova-compute[70709]:       <nova:owner>
Jul 28 00:53:25 user nova-compute[70709]:         <nova:user uuid="bef098a320ff4116b6ea7cb12d6aa41a">tempest-AttachVolumeShelveTestJSON-2054382732-project-member</nova:user>
Jul 28 00:53:25 user nova-compute[70709]:         <nova:project uuid="be36b20189ca4ac5880e2404b59f20dc">tempest-AttachVolumeShelveTestJSON-2054382732</nova:project>
Jul 28 00:53:25 user nova-compute[70709]:       </nova:owner>
Jul 28 00:53:25 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 00:53:25 user nova-compute[70709]:       <nova:ports>
Jul 28 00:53:25 user nova-compute[70709]:         <nova:port uuid="6baec140-9c13-4795-94e7-19992ffba645">
Jul 28 00:53:25 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 28 00:53:25 user nova-compute[70709]:         </nova:port>
Jul 28 00:53:25 user nova-compute[70709]:       </nova:ports>
Jul 28 00:53:25 user nova-compute[70709]:     </nova:instance>
Jul 28 00:53:25 user nova-compute[70709]:   </metadata>
Jul 28 00:53:25 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:53:25 user nova-compute[70709]:     <system>
Jul 28 00:53:25 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:53:25 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:53:25 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:53:25 user nova-compute[70709]:       <entry name="serial">6dd25a67-f89b-48fb-972a-4d1098a2418e</entry>
Jul 28 00:53:25 user nova-compute[70709]:       <entry name="uuid">6dd25a67-f89b-48fb-972a-4d1098a2418e</entry>
Jul 28 00:53:25 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:53:25 user nova-compute[70709]:     </system>
Jul 28 00:53:25 user nova-compute[70709]:   </sysinfo>
Jul 28 00:53:25 user nova-compute[70709]:   <os>
Jul 28 00:53:25 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:53:25 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:53:25 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:53:25 user nova-compute[70709]:   </os>
Jul 28 00:53:25 user nova-compute[70709]:   <features>
Jul 28 00:53:25 user nova-compute[70709]:     <acpi/>
Jul 28 00:53:25 user nova-compute[70709]:     <apic/>
Jul 28 00:53:25 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:53:25 user nova-compute[70709]:   </features>
Jul 28 00:53:25 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:53:25 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:53:25 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:53:25 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:53:25 user nova-compute[70709]:   </clock>
Jul 28 00:53:25 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:53:25 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:53:25 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:53:25 user nova-compute[70709]:   </cpu>
Jul 28 00:53:25 user nova-compute[70709]:   <devices>
Jul 28 00:53:25 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:53:25 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:53:25 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk"/>
Jul 28 00:53:25 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:53:25 user nova-compute[70709]:     </disk>
Jul 28 00:53:25 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:53:25 user nova-compute[70709]:       <mac address="fa:16:3e:9e:a1:90"/>
Jul 28 00:53:25 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:53:25 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:53:25 user nova-compute[70709]:       <target dev="tap6baec140-9c"/>
Jul 28 00:53:25 user nova-compute[70709]:     </interface>
Jul 28 00:53:25 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:53:25 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/console.log" append="off"/>
Jul 28 00:53:25 user nova-compute[70709]:     </serial>
Jul 28 00:53:25 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:53:25 user nova-compute[70709]:     <video>
Jul 28 00:53:25 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:53:25 user nova-compute[70709]:     </video>
Jul 28 00:53:25 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:53:25 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:53:25 user nova-compute[70709]:     </rng>
Jul 28 00:53:25 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:53:25 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:53:25 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:53:25 user nova-compute[70709]:     </memballoon>
Jul 28 00:53:25 user nova-compute[70709]:   </devices>
Jul 28 00:53:25 user nova-compute[70709]: </domain>
Jul 28 00:53:25 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620221260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620221260',id=49,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQucKfe6jIWE1eH7EoKoLkvCwj1BrAVMLYkVE8VU2PBF/S85mzI+jJTXyZ0aTHz8dM/okRzJ1/AVwE1jb+X9/G1I1IKxShrc2+6uWDJeTPWV8nqu6eavluWn/ZOdfcu9Q==',key_name='tempest-keypair-405379372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-2ac8q871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=6dd25a67-f89b-48fb-972a-4d1098a2418e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG os_vif [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6baec140-9c, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6baec140-9c, col_values=(('external_ids', {'iface-id': '6baec140-9c13-4795-94e7-19992ffba645', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:a1:90', 'vm-uuid': '6dd25a67-f89b-48fb-972a-4d1098a2418e'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:25 user nova-compute[70709]: INFO os_vif [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c')
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] No VIF found with MAC fa:16:3e:9e:a1:90, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.network.neutron [req-83ae604c-3acb-4b24-b6ec-8669fb76f7f0 req-a56d6047-0383-4920-aa8f-e7b9794a0737 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updated VIF entry in instance network info cache for port 6baec140-9c13-4795-94e7-19992ffba645. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG nova.network.neutron [req-83ae604c-3acb-4b24-b6ec-8669fb76f7f0 req-a56d6047-0383-4920-aa8f-e7b9794a0737 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:53:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-83ae604c-3acb-4b24-b6ec-8669fb76f7f0 req-a56d6047-0383-4920-aa8f-e7b9794a0737 service nova] Releasing lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:53:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-e2ecf4bf-4250-4d79-8963-69eeb2682dde req-1ee2d7aa-3b46-4e26-be8e-24e7125fb98f service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:53:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e2ecf4bf-4250-4d79-8963-69eeb2682dde req-1ee2d7aa-3b46-4e26-be8e-24e7125fb98f service nova] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:53:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e2ecf4bf-4250-4d79-8963-69eeb2682dde req-1ee2d7aa-3b46-4e26-be8e-24e7125fb98f service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:53:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-e2ecf4bf-4250-4d79-8963-69eeb2682dde req-1ee2d7aa-3b46-4e26-be8e-24e7125fb98f service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:53:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-e2ecf4bf-4250-4d79-8963-69eeb2682dde req-1ee2d7aa-3b46-4e26-be8e-24e7125fb98f service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] No waiting events found dispatching network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:53:27 user nova-compute[70709]: WARNING nova.compute.manager [req-e2ecf4bf-4250-4d79-8963-69eeb2682dde req-1ee2d7aa-3b46-4e26-be8e-24e7125fb98f service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received unexpected event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 for instance with vm_state building and task_state spawning.
Jul 28 00:53:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505608.89208, 6dd25a67-f89b-48fb-972a-4d1098a2418e => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:53:28 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] VM Resumed (Lifecycle Event)
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:53:28 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Instance spawned successfully.
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 00:53:28 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505608.8952577, 6dd25a67-f89b-48fb-972a-4d1098a2418e => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:53:28 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] VM Started (Lifecycle Event)
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:53:28 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:53:28 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:53:29 user nova-compute[70709]: INFO nova.compute.manager [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Took 5.33 seconds to spawn the instance on the hypervisor.
Jul 28 00:53:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:53:29 user nova-compute[70709]: INFO nova.compute.manager [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Took 5.93 seconds to build instance.
Jul 28 00:53:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bbe78ae8-8b90-49ce-a2e4-4e5bdfd3117a tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.032s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:53:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-8935965c-e294-44b8-9f4a-9123c1b2cda8 req-5be0df4a-2607-4b87-917f-57bb252d13b4 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:53:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8935965c-e294-44b8-9f4a-9123c1b2cda8 req-5be0df4a-2607-4b87-917f-57bb252d13b4 service nova] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:53:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8935965c-e294-44b8-9f4a-9123c1b2cda8 req-5be0df4a-2607-4b87-917f-57bb252d13b4 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:53:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-8935965c-e294-44b8-9f4a-9123c1b2cda8 req-5be0df4a-2607-4b87-917f-57bb252d13b4 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:53:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-8935965c-e294-44b8-9f4a-9123c1b2cda8 req-5be0df4a-2607-4b87-917f-57bb252d13b4 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] No waiting events found dispatching network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:53:29 user nova-compute[70709]: WARNING nova.compute.manager [req-8935965c-e294-44b8-9f4a-9123c1b2cda8 req-5be0df4a-2607-4b87-917f-57bb252d13b4 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received unexpected event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 for instance with vm_state active and task_state None.
Jul 28 00:53:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:38 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:53:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:53:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:53:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:53:38 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:53:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:53:39 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:53:39 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:53:39 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=25.271488189697266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 6dd25a67-f89b-48fb-972a-4d1098a2418e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:53:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:53:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:53:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:53:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:53:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:53:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:53:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:53:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:53:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:53:42 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:53:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:43 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:53:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:49 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:53:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:50 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:53:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:53:55 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:53:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:53:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:53:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:53:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:53:55 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:53:55 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:53:56 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:53:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:53:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:53:57 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:53:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:54:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:54:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:54:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:54:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:54:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:54:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:54:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:54:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:54:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:54:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:54:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:54:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:54:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:54:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:54:41 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:54:41 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:54:41 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8879MB free_disk=25.243099212646484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 6dd25a67-f89b-48fb-972a-4d1098a2418e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:54:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:54:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:54:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:54:44 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:54:44 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:54:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:54:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:54:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:54:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:54:49 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:54:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:51 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:54:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:54:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:54:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:54:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:54:56 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:54:57 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:54:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:54:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:54:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:54:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:54:58 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:54:58 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:54:58 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:54:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:54:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:54:58 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:55:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:55:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:55:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:55:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:55:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:55:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:55:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:55:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:55:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:55:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:55:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:55:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-010b16c4-3a17-4dc4-a12f-af9c2f85ac19 req-f7f172a7-27e5-4b1c-b890-ef2f3d2c435d service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-changed-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:55:14 user nova-compute[70709]: DEBUG nova.compute.manager [req-010b16c4-3a17-4dc4-a12f-af9c2f85ac19 req-f7f172a7-27e5-4b1c-b890-ef2f3d2c435d service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Refreshing instance network info cache due to event network-changed-6baec140-9c13-4795-94e7-19992ffba645. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:55:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-010b16c4-3a17-4dc4-a12f-af9c2f85ac19 req-f7f172a7-27e5-4b1c-b890-ef2f3d2c435d service nova] Acquiring lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:55:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-010b16c4-3a17-4dc4-a12f-af9c2f85ac19 req-f7f172a7-27e5-4b1c-b890-ef2f3d2c435d service nova] Acquired lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:55:14 user nova-compute[70709]: DEBUG nova.network.neutron [req-010b16c4-3a17-4dc4-a12f-af9c2f85ac19 req-f7f172a7-27e5-4b1c-b890-ef2f3d2c435d service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Refreshing network info cache for port 6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:55:14 user nova-compute[70709]: DEBUG nova.network.neutron [req-010b16c4-3a17-4dc4-a12f-af9c2f85ac19 req-f7f172a7-27e5-4b1c-b890-ef2f3d2c435d service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updated VIF entry in instance network info cache for port 6baec140-9c13-4795-94e7-19992ffba645. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:55:14 user nova-compute[70709]: DEBUG nova.network.neutron [req-010b16c4-3a17-4dc4-a12f-af9c2f85ac19 req-f7f172a7-27e5-4b1c-b890-ef2f3d2c435d service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:55:14 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-010b16c4-3a17-4dc4-a12f-af9c2f85ac19 req-f7f172a7-27e5-4b1c-b890-ef2f3d2c435d service nova] Releasing lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:55:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:55:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:55:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:55:18 user nova-compute[70709]: INFO nova.compute.manager [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Shelving
Jul 28 00:55:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-04a8e8e8-2a2d-479d-bde7-451654bfe7f0 req-3c6661fb-e739-4ea1-a741-267abc36f188 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-vif-unplugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:55:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04a8e8e8-2a2d-479d-bde7-451654bfe7f0 req-3c6661fb-e739-4ea1-a741-267abc36f188 service nova] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:55:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04a8e8e8-2a2d-479d-bde7-451654bfe7f0 req-3c6661fb-e739-4ea1-a741-267abc36f188 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:55:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-04a8e8e8-2a2d-479d-bde7-451654bfe7f0 req-3c6661fb-e739-4ea1-a741-267abc36f188 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:55:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-04a8e8e8-2a2d-479d-bde7-451654bfe7f0 req-3c6661fb-e739-4ea1-a741-267abc36f188 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] No waiting events found dispatching network-vif-unplugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:55:19 user nova-compute[70709]: WARNING nova.compute.manager [req-04a8e8e8-2a2d-479d-bde7-451654bfe7f0 req-3c6661fb-e739-4ea1-a741-267abc36f188 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received unexpected event network-vif-unplugged-6baec140-9c13-4795-94e7-19992ffba645 for instance with vm_state active and task_state shelving.
Jul 28 00:55:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:19 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Instance destroyed successfully.
Jul 28 00:55:19 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Beginning cold snapshot process
Jul 28 00:55:19 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:55:19 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk /opt/stack/data/nova/instances/snapshots/tmpvt5h76w0/358d4f7dee3141cfb9c594d6eb038409 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:55:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk /opt/stack/data/nova/instances/snapshots/tmpvt5h76w0/358d4f7dee3141cfb9c594d6eb038409" returned: 0 in 0.541s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:55:20 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Snapshot extracted, beginning image upload
Jul 28 00:55:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-de3eba75-7aee-43cb-ab2c-6db59dffaaef req-76c7a917-32e1-44d1-94af-b5d70d3d8003 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:55:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-de3eba75-7aee-43cb-ab2c-6db59dffaaef req-76c7a917-32e1-44d1-94af-b5d70d3d8003 service nova] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:55:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-de3eba75-7aee-43cb-ab2c-6db59dffaaef req-76c7a917-32e1-44d1-94af-b5d70d3d8003 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:55:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-de3eba75-7aee-43cb-ab2c-6db59dffaaef req-76c7a917-32e1-44d1-94af-b5d70d3d8003 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:55:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-de3eba75-7aee-43cb-ab2c-6db59dffaaef req-76c7a917-32e1-44d1-94af-b5d70d3d8003 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] No waiting events found dispatching network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:55:21 user nova-compute[70709]: WARNING nova.compute.manager [req-de3eba75-7aee-43cb-ab2c-6db59dffaaef req-76c7a917-32e1-44d1-94af-b5d70d3d8003 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received unexpected event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 for instance with vm_state active and task_state shelving_image_uploading.
Jul 28 00:55:22 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Snapshot image upload complete
Jul 28 00:55:22 user nova-compute[70709]: DEBUG nova.compute.manager [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:55:22 user nova-compute[70709]: INFO nova.compute.manager [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Shelve offloading
Jul 28 00:55:22 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Instance destroyed successfully.
Jul 28 00:55:22 user nova-compute[70709]: DEBUG nova.compute.manager [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:55:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:55:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquired lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:55:22 user nova-compute[70709]: DEBUG nova.network.neutron [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:55:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:55:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Releasing lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:55:24 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Instance destroyed successfully.
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.objects.instance [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'resources' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T00:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620221260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620221260',id=49,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQucKfe6jIWE1eH7EoKoLkvCwj1BrAVMLYkVE8VU2PBF/S85mzI+jJTXyZ0aTHz8dM/okRzJ1/AVwE1jb+X9/G1I1IKxShrc2+6uWDJeTPWV8nqu6eavluWn/ZOdfcu9Q==',key_name='tempest-keypair-405379372',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:53:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-2ac8q871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member',shelved_at='2023-07-28T00:55:22.704514',shelved_host='user',shelved_image_id='71ddfc37-4132-4ed8-bf17-484f20c685f1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=6dd25a67-f89b-48fb-972a-4d1098a2418e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG os_vif [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6baec140-9c, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.compute.manager [req-92866297-4513-415b-b5fa-280f8183f0fa req-2c26d3c5-f9b4-4d19-b5eb-6474872efcfe service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-changed-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.compute.manager [req-92866297-4513-415b-b5fa-280f8183f0fa req-2c26d3c5-f9b4-4d19-b5eb-6474872efcfe service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Refreshing instance network info cache due to event network-changed-6baec140-9c13-4795-94e7-19992ffba645. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-92866297-4513-415b-b5fa-280f8183f0fa req-2c26d3c5-f9b4-4d19-b5eb-6474872efcfe service nova] Acquiring lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-92866297-4513-415b-b5fa-280f8183f0fa req-2c26d3c5-f9b4-4d19-b5eb-6474872efcfe service nova] Acquired lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.network.neutron [req-92866297-4513-415b-b5fa-280f8183f0fa req-2c26d3c5-f9b4-4d19-b5eb-6474872efcfe service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Refreshing network info cache for port 6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:55:24 user nova-compute[70709]: INFO os_vif [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c')
Jul 28 00:55:24 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Deleting instance files /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e_del
Jul 28 00:55:24 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Deletion of /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e_del complete
Jul 28 00:55:24 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Deleted allocations for instance 6dd25a67-f89b-48fb-972a-4d1098a2418e
Jul 28 00:55:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.objects.instance [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'numa_topology' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3328c6dc-080c-460e-8e48-941cb554ad9d tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.034s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.network.neutron [req-92866297-4513-415b-b5fa-280f8183f0fa req-2c26d3c5-f9b4-4d19-b5eb-6474872efcfe service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updated VIF entry in instance network info cache for port 6baec140-9c13-4795-94e7-19992ffba645. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG nova.network.neutron [req-92866297-4513-415b-b5fa-280f8183f0fa req-2c26d3c5-f9b4-4d19-b5eb-6474872efcfe service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6baec140-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:55:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-92866297-4513-415b-b5fa-280f8183f0fa req-2c26d3c5-f9b4-4d19-b5eb-6474872efcfe service nova] Releasing lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:55:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:34 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690505719.5603719, 6dd25a67-f89b-48fb-972a-4d1098a2418e => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:55:34 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] VM Stopped (Lifecycle Event)
Jul 28 00:55:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-de2a3878-ac44-4c6f-8f1f-6161d97dfa06 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:55:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:40 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:55:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:55:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:55:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:55:40 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:55:41 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:55:41 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:55:41 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=9007MB free_disk=25.22130584716797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:55:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:55:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:55:41 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:55:41 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:55:41 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:55:41 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:55:41 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:55:41 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:55:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:44 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:55:44 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:55:44 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:55:44 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:55:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:55:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:50 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:55:53 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:55:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:55:57 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:55:58 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:55:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 00:55:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:55:59 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:55:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:55:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:55:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:56:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:56:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:56:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:56:15 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:56:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 00:56:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 00:56:16 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:56:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:56:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:56:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:56:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:56:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:56:42 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:56:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:56:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:56:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:56:42 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:56:43 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:56:43 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:56:43 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=9020MB free_disk=25.220748901367188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:56:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:56:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:56:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:56:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:56:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:56:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:56:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:56:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:56:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:56:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:56:45 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:56:46 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:56:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:56:52 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:56:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:56:54 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:56:58 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:56:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:57:00 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:57:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:57:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:57:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:57:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 00:57:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:57:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:57:11 user nova-compute[70709]: INFO nova.compute.manager [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Unshelving
Jul 28 00:57:11 user nova-compute[70709]: INFO nova.virt.block_device [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Booting with volume 95d4a28b-2113-4ab6-9eb2-a02e1695b075 at /dev/vdc
Jul 28 00:57:11 user nova-compute[70709]: DEBUG os_brick.utils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4840f2-c630-4377-9f82-a2b34fb7dce7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[59399df8-e392-4d94-adf8-2b881b8398cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb2297f-5697-45f7-ab49-681f2e21106a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[839465b9-1b0e-4b64-9e19-c212e0ac0ae9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 00:57:11 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 00:57:11 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb4fa1-6c1b-4f87-b79a-12c36672636f]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG os_brick.utils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:57:11 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating existing volume attachment record: e5c3e422-54fe-4d8c-8781-157f48d8cb49 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 00:57:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:57:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:57:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:57:18 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'pci_requests' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:57:18 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'numa_topology' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:57:18 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 00:57:18 user nova-compute[70709]: INFO nova.compute.claims [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Claim successful on node user
Jul 28 00:57:18 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:57:18 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:57:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:57:18 user nova-compute[70709]: INFO nova.network.neutron [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating port 6baec140-9c13-4795-94e7-19992ffba645 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 28 00:57:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:57:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquired lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:57:19 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 00:57:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-22435ab0-2858-4cd5-bf82-0702cee06133 req-03fc4b74-dfe0-4060-b898-adeae96bed92 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-changed-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:57:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-22435ab0-2858-4cd5-bf82-0702cee06133 req-03fc4b74-dfe0-4060-b898-adeae96bed92 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Refreshing instance network info cache due to event network-changed-6baec140-9c13-4795-94e7-19992ffba645. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 00:57:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-22435ab0-2858-4cd5-bf82-0702cee06133 req-03fc4b74-dfe0-4060-b898-adeae96bed92 service nova] Acquiring lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:57:20 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:57:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Releasing lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:57:20 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 00:57:20 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Creating image(s)
Jul 28 00:57:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "/opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:57:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "/opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:57:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "/opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:57:20 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:57:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-22435ab0-2858-4cd5-bf82-0702cee06133 req-03fc4b74-dfe0-4060-b898-adeae96bed92 service nova] Acquired lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:57:20 user nova-compute[70709]: DEBUG nova.network.neutron [req-22435ab0-2858-4cd5-bf82-0702cee06133 req-03fc4b74-dfe0-4060-b898-adeae96bed92 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Refreshing network info cache for port 6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 00:57:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "92a16e8dd26a4ba89ed9b477106f2311ce9c84a0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:57:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "92a16e8dd26a4ba89ed9b477106f2311ce9c84a0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:57:20 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0.part --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0.part --force-share --output=json" returned: 0 in 0.143s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG nova.virt.images [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] 71ddfc37-4132-4ed8-bf17-484f20c685f1 was qcow2, converting to raw {{(pid=70709) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0.part /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0.converted {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG nova.network.neutron [req-22435ab0-2858-4cd5-bf82-0702cee06133 req-03fc4b74-dfe0-4060-b898-adeae96bed92 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updated VIF entry in instance network info cache for port 6baec140-9c13-4795-94e7-19992ffba645. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG nova.network.neutron [req-22435ab0-2858-4cd5-bf82-0702cee06133 req-03fc4b74-dfe0-4060-b898-adeae96bed92 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-22435ab0-2858-4cd5-bf82-0702cee06133 req-03fc4b74-dfe0-4060-b898-adeae96bed92 service nova] Releasing lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0.part /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0.converted" returned: 0 in 0.496s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0.converted --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0.converted --force-share --output=json" returned: 0 in 0.131s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "92a16e8dd26a4ba89ed9b477106f2311ce9c84a0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.602s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0 --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "92a16e8dd26a4ba89ed9b477106f2311ce9c84a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "92a16e8dd26a4ba89ed9b477106f2311ce9c84a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:57:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0 --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0,backing_fmt=raw /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0,backing_fmt=raw /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk 1073741824" returned: 0 in 0.057s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "92a16e8dd26a4ba89ed9b477106f2311ce9c84a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:57:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a16e8dd26a4ba89ed9b477106f2311ce9c84a0 --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:22 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'migration_context' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:57:22 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Rebasing disk image.
Jul 28 00:57:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.135s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:22 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 -F raw /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 -F raw /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk" returned: 0 in 2.016s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Ensure instance console log exists: /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Start _get_guest_xml network_info=[{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='908d0e4b20984d262f3644cfff353a37',container_format='bare',created_at=2023-07-28T00:55:19Z,direct_url=<?>,disk_format='qcow2',id=71ddfc37-4132-4ed8-bf17-484f20c685f1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-620221260-shelved',owner='be36b20189ca4ac5880e2404b59f20dc',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-28T00:55:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'e5c3e422-54fe-4d8c-8781-157f48d8cb49', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agDswGPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6dd25a67-f89b-48fb-972a-4d1098a2418e', 'attached_at': '', 'detached_at': '', 'volume_id': '95d4a28b-2113-4ab6-9eb2-a02e1695b075', 'serial': '95d4a28b-2113-4ab6-9eb2-a02e1695b075'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:24 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:57:24 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='908d0e4b20984d262f3644cfff353a37',container_format='bare',created_at=2023-07-28T00:55:19Z,direct_url=<?>,disk_format='qcow2',id=71ddfc37-4132-4ed8-bf17-484f20c685f1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-620221260-shelved',owner='be36b20189ca4ac5880e2404b59f20dc',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-28T00:55:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agDswGPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:57:24 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:57:24 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:57:24 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e69859-e8c3-47f7-98b4-76d986c99fee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 00:57:24 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86a30e0-003c-437c-bf8e-d0af80630b7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075] added
Jul 28 00:57:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6529f66-08d7-42c3-8b51-2a7c14aa4118]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[986e770f-9424-4088-8cc7-be2b99da4b39]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v agDswGPN {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v agDswGPN" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72667cf-73c0-4149-800e-09fc5f72a730]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'agDswGPN'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb5e01e-4776-4770-be0c-18522c724d6a]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[84182131-2590-4d1c-aa23-5c849e6c506e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 28 00:57:24 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 28 00:57:24 user nova-compute[70709]:  {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:57:24 user nova-compute[70709]: WARNING os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 28 00:57:24 user nova-compute[70709]: 
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb700b-d0b6-4a92-8402-f184d0b7414d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075, portal: 172.16.0.220,3260]
Jul 28 00:57:24 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075, portal: 172.16.0.220,3260] successful.
Jul 28 00:57:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb51225-24a2-4301-8cab-512beb19c287]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c30c6-4065-4bc3-bd75-a46d399e5a00]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 (non-flash)
Jul 28 00:57:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 (non-flash)
Jul 28 00:57:24 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ee423-0644-41b6-a289-a2bc6e65fbb0]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 00:57:24 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agDswGPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23264633864643365', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264633864643365', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T00:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620221260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620221260',id=49,image_ref='71ddfc37-4132-4ed8-bf17-484f20c685f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-405379372',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:53:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-2ac8q871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member',shelved_at='2023-07-28T00:55:22.704514',shelved_host='user',shelved_image_id='71ddfc37-4132-4ed8-bf17-484f20c685f1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:57:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=6dd25a67-f89b-48fb-972a-4d1098a2418e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] End _get_guest_xml xml=<domain type="kvm">
Jul 28 00:57:25 user nova-compute[70709]:   <uuid>6dd25a67-f89b-48fb-972a-4d1098a2418e</uuid>
Jul 28 00:57:25 user nova-compute[70709]:   <name>instance-00000031</name>
Jul 28 00:57:25 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 00:57:25 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 00:57:25 user nova-compute[70709]:   <metadata>
Jul 28 00:57:25 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 00:57:25 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 00:57:25 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-620221260</nova:name>
Jul 28 00:57:25 user nova-compute[70709]:       <nova:creationTime>2023-07-28 00:57:24</nova:creationTime>
Jul 28 00:57:25 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 00:57:25 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 00:57:25 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 00:57:25 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 00:57:25 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 00:57:25 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 00:57:25 user nova-compute[70709]:       </nova:flavor>
Jul 28 00:57:25 user nova-compute[70709]:       <nova:owner>
Jul 28 00:57:25 user nova-compute[70709]:         <nova:user uuid="bef098a320ff4116b6ea7cb12d6aa41a">tempest-AttachVolumeShelveTestJSON-2054382732-project-member</nova:user>
Jul 28 00:57:25 user nova-compute[70709]:         <nova:project uuid="be36b20189ca4ac5880e2404b59f20dc">tempest-AttachVolumeShelveTestJSON-2054382732</nova:project>
Jul 28 00:57:25 user nova-compute[70709]:       </nova:owner>
Jul 28 00:57:25 user nova-compute[70709]:       <nova:root type="image" uuid="71ddfc37-4132-4ed8-bf17-484f20c685f1"/>
Jul 28 00:57:25 user nova-compute[70709]:       <nova:ports>
Jul 28 00:57:25 user nova-compute[70709]:         <nova:port uuid="6baec140-9c13-4795-94e7-19992ffba645">
Jul 28 00:57:25 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 28 00:57:25 user nova-compute[70709]:         </nova:port>
Jul 28 00:57:25 user nova-compute[70709]:       </nova:ports>
Jul 28 00:57:25 user nova-compute[70709]:     </nova:instance>
Jul 28 00:57:25 user nova-compute[70709]:   </metadata>
Jul 28 00:57:25 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 00:57:25 user nova-compute[70709]:     <system>
Jul 28 00:57:25 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 00:57:25 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 00:57:25 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 00:57:25 user nova-compute[70709]:       <entry name="serial">6dd25a67-f89b-48fb-972a-4d1098a2418e</entry>
Jul 28 00:57:25 user nova-compute[70709]:       <entry name="uuid">6dd25a67-f89b-48fb-972a-4d1098a2418e</entry>
Jul 28 00:57:25 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 00:57:25 user nova-compute[70709]:     </system>
Jul 28 00:57:25 user nova-compute[70709]:   </sysinfo>
Jul 28 00:57:25 user nova-compute[70709]:   <os>
Jul 28 00:57:25 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 00:57:25 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 00:57:25 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 00:57:25 user nova-compute[70709]:   </os>
Jul 28 00:57:25 user nova-compute[70709]:   <features>
Jul 28 00:57:25 user nova-compute[70709]:     <acpi/>
Jul 28 00:57:25 user nova-compute[70709]:     <apic/>
Jul 28 00:57:25 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 00:57:25 user nova-compute[70709]:   </features>
Jul 28 00:57:25 user nova-compute[70709]:   <clock offset="utc">
Jul 28 00:57:25 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 00:57:25 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 00:57:25 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 00:57:25 user nova-compute[70709]:   </clock>
Jul 28 00:57:25 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 00:57:25 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 00:57:25 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 00:57:25 user nova-compute[70709]:   </cpu>
Jul 28 00:57:25 user nova-compute[70709]:   <devices>
Jul 28 00:57:25 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 00:57:25 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 00:57:25 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk"/>
Jul 28 00:57:25 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 00:57:25 user nova-compute[70709]:     </disk>
Jul 28 00:57:25 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 00:57:25 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:57:25 user nova-compute[70709]:       <source dev="/dev/sdb"/>
Jul 28 00:57:25 user nova-compute[70709]:       <target dev="vdc" bus="virtio"/>
Jul 28 00:57:25 user nova-compute[70709]:       <serial>95d4a28b-2113-4ab6-9eb2-a02e1695b075</serial>
Jul 28 00:57:25 user nova-compute[70709]:     </disk>
Jul 28 00:57:25 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 00:57:25 user nova-compute[70709]:       <mac address="fa:16:3e:9e:a1:90"/>
Jul 28 00:57:25 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:57:25 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 00:57:25 user nova-compute[70709]:       <target dev="tap6baec140-9c"/>
Jul 28 00:57:25 user nova-compute[70709]:     </interface>
Jul 28 00:57:25 user nova-compute[70709]:     <serial type="pty">
Jul 28 00:57:25 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/console.log" append="off"/>
Jul 28 00:57:25 user nova-compute[70709]:     </serial>
Jul 28 00:57:25 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 00:57:25 user nova-compute[70709]:     <video>
Jul 28 00:57:25 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 00:57:25 user nova-compute[70709]:     </video>
Jul 28 00:57:25 user nova-compute[70709]:     <rng model="virtio">
Jul 28 00:57:25 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 00:57:25 user nova-compute[70709]:     </rng>
Jul 28 00:57:25 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 00:57:25 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 00:57:25 user nova-compute[70709]:       <stats period="10"/>
Jul 28 00:57:25 user nova-compute[70709]:     </memballoon>
Jul 28 00:57:25 user nova-compute[70709]:   </devices>
Jul 28 00:57:25 user nova-compute[70709]: </domain>
Jul 28 00:57:25 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T00:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620221260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620221260',id=49,image_ref='71ddfc37-4132-4ed8-bf17-484f20c685f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-405379372',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:53:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-2ac8q871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member',shelved_at='2023-07-28T00:55:22.704514',shelved_host='user',shelved_image_id='71ddfc37-4132-4ed8-bf17-484f20c685f1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T00:57:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=6dd25a67-f89b-48fb-972a-4d1098a2418e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG os_vif [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6baec140-9c, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6baec140-9c, col_values=(('external_ids', {'iface-id': '6baec140-9c13-4795-94e7-19992ffba645', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:a1:90', 'vm-uuid': '6dd25a67-f89b-48fb-972a-4d1098a2418e'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:25 user nova-compute[70709]: INFO os_vif [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c')
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 00:57:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] No VIF found with MAC fa:16:3e:9e:a1:90, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 00:57:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-f8ba0756-20d1-45c3-ad23-d0ffb07be10a req-76a87611-5cba-4d44-812d-77a09eedf0ca service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:57:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f8ba0756-20d1-45c3-ad23-d0ffb07be10a req-76a87611-5cba-4d44-812d-77a09eedf0ca service nova] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:57:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f8ba0756-20d1-45c3-ad23-d0ffb07be10a req-76a87611-5cba-4d44-812d-77a09eedf0ca service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:57:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f8ba0756-20d1-45c3-ad23-d0ffb07be10a req-76a87611-5cba-4d44-812d-77a09eedf0ca service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:57:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-f8ba0756-20d1-45c3-ad23-d0ffb07be10a req-76a87611-5cba-4d44-812d-77a09eedf0ca service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] No waiting events found dispatching network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:57:27 user nova-compute[70709]: WARNING nova.compute.manager [req-f8ba0756-20d1-45c3-ad23-d0ffb07be10a req-76a87611-5cba-4d44-812d-77a09eedf0ca service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received unexpected event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 28 00:57:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:29 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505849.3016686, 6dd25a67-f89b-48fb-972a-4d1098a2418e => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:57:29 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] VM Resumed (Lifecycle Event)
Jul 28 00:57:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 00:57:29 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 00:57:29 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Instance spawned successfully.
Jul 28 00:57:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:57:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:57:29 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:57:29 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690505849.3071423, 6dd25a67-f89b-48fb-972a-4d1098a2418e => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 00:57:29 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] VM Started (Lifecycle Event)
Jul 28 00:57:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:57:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 00:57:29 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 00:57:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-511d22fa-2dc5-42df-8999-28ebb040b435 req-4ab05d1d-dbf2-4fc6-a14f-9f389dbbae33 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:57:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-511d22fa-2dc5-42df-8999-28ebb040b435 req-4ab05d1d-dbf2-4fc6-a14f-9f389dbbae33 service nova] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:57:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-511d22fa-2dc5-42df-8999-28ebb040b435 req-4ab05d1d-dbf2-4fc6-a14f-9f389dbbae33 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:57:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-511d22fa-2dc5-42df-8999-28ebb040b435 req-4ab05d1d-dbf2-4fc6-a14f-9f389dbbae33 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:57:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-511d22fa-2dc5-42df-8999-28ebb040b435 req-4ab05d1d-dbf2-4fc6-a14f-9f389dbbae33 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] No waiting events found dispatching network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:57:29 user nova-compute[70709]: WARNING nova.compute.manager [req-511d22fa-2dc5-42df-8999-28ebb040b435 req-4ab05d1d-dbf2-4fc6-a14f-9f389dbbae33 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received unexpected event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 28 00:57:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 00:57:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9ac6673d-26b2-4b10-8b92-a76212214bec tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.375s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:57:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:57:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:57:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:57:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:57:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:43 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:57:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:57:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:57:43 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:57:43 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:57:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:57:44 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:57:44 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:57:44 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.194530487060547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 6dd25a67-f89b-48fb-972a-4d1098a2418e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:57:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:57:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:57:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:47 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:57:47 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:57:47 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:57:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:57:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:54 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:57:54 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:57:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:57:58 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:58:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:03 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:58:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:58:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:58:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:58:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:58:03 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:58:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:58:04 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:58:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:58:04 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:58:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:58:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:58:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:58:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:58:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:58:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:44 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:58:44 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:58:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:58:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:58:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:58:44 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:58:44 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 00:58:45 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:58:45 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:58:45 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=25.193767547607422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 6dd25a67-f89b-48fb-972a-4d1098a2418e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:58:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:58:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:58:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:58:49 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:58:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:58:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:58:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:58:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:58:56 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:58:56 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:58:59 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:59:00 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:59:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:59:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:59:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:59:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:59:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:59:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:59:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:59:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:59:01 user nova-compute[70709]: INFO nova.compute.manager [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Detaching volume 95d4a28b-2113-4ab6-9eb2-a02e1695b075
Jul 28 00:59:01 user nova-compute[70709]: INFO nova.virt.block_device [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Attempting to driver detach volume 95d4a28b-2113-4ab6-9eb2-a02e1695b075 from mountpoint /dev/vdc
Jul 28 00:59:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Attempting to detach device vdc from instance 6dd25a67-f89b-48fb-972a-4d1098a2418e from the persistent domain config. {{(pid=70709) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 28 00:59:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:59:01 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:59:01 user nova-compute[70709]:   <source dev="/dev/sdb"/>
Jul 28 00:59:01 user nova-compute[70709]:   <target dev="vdc" bus="virtio"/>
Jul 28 00:59:01 user nova-compute[70709]:   <serial>95d4a28b-2113-4ab6-9eb2-a02e1695b075</serial>
Jul 28 00:59:01 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 28 00:59:01 user nova-compute[70709]: </disk>
Jul 28 00:59:01 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:59:01 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Successfully detached device vdc from instance 6dd25a67-f89b-48fb-972a-4d1098a2418e from the persistent domain config.
Jul 28 00:59:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6dd25a67-f89b-48fb-972a-4d1098a2418e from the live domain config. {{(pid=70709) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 28 00:59:01 user nova-compute[70709]: DEBUG nova.virt.libvirt.guest [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] detach device xml: <disk type="block" device="disk">
Jul 28 00:59:01 user nova-compute[70709]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 00:59:01 user nova-compute[70709]:   <source dev="/dev/sdb"/>
Jul 28 00:59:01 user nova-compute[70709]:   <target dev="vdc" bus="virtio"/>
Jul 28 00:59:01 user nova-compute[70709]:   <serial>95d4a28b-2113-4ab6-9eb2-a02e1695b075</serial>
Jul 28 00:59:01 user nova-compute[70709]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 28 00:59:01 user nova-compute[70709]: </disk>
Jul 28 00:59:01 user nova-compute[70709]:  {{(pid=70709) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Received event <DeviceRemovedEvent: 1690505942.1102903, 6dd25a67-f89b-48fb-972a-4d1098a2418e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70709) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 28 00:59:02 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Successfully detached device vdc from instance 6dd25a67-f89b-48fb-972a-4d1098a2418e from the live domain config.
Jul 28 00:59:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agDswGPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 00:59:02 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d6628-6187-417e-9117-1a4d9d955746]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 00:59:02 user nova-compute[70709]: No targets found.
Jul 28 00:59:02 user nova-compute[70709]: iSNS:
Jul 28 00:59:02 user nova-compute[70709]: No targets found.
Jul 28 00:59:02 user nova-compute[70709]: STATIC:
Jul 28 00:59:02 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075
Jul 28 00:59:02 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 00:59:02 user nova-compute[70709]:                 Iface Name: default
Jul 28 00:59:02 user nova-compute[70709]: FIRMWARE:
Jul 28 00:59:02 user nova-compute[70709]: No targets found.
Jul 28 00:59:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 00:59:02 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 00:59:02 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[10741bf4-d5cf-4908-bce6-85fecf995bca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f59342f-201b-4226-9841-6a3b60b49c88]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 (non-flash)
Jul 28 00:59:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 (non-flash)
Jul 28 00:59:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b883d3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075'): ({'sdb'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Removing single pathed devices sdb {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a723fc0-fdc8-45f7-b675-792b6b28ba8b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca08b8c-3c8b-4e80-bd50-3a542e31b627]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Flushing IO for device /dev/sdb {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0432eb1-497d-4fa8-bd33-d87fd8bd3f43]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a979263-ea88-4389-8226-32147abbf13b]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca698ec-24ea-489e-bc2b-c7cc46abbb57]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[87993174-571e-4985-b8a2-6d7a6a52a8a0]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075, portal: 172.16.0.220,3260]
Jul 28 00:59:02 user nova-compute[70709]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075, portal: 172.16.0.220,3260] successful.
Jul 28 00:59:02 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d4a28b-2113-4ab6-9eb2-a02e1695b075 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[038cc35c-5309-4457-afb5-6aefb94e9bd5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] <== disconnect_volume: return (305ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 00:59:02 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 00:59:03 user nova-compute[70709]: DEBUG nova.objects.instance [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'flavor' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:59:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-240c9ad0-5c94-486c-9046-bc4c3d952076 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.570s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:59:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:04 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:59:04 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 00:59:04 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 00:59:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 00:59:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 00:59:04 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 00:59:04 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:59:05 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [{"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:59:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-6dd25a67-f89b-48fb-972a-4d1098a2418e" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 00:59:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 00:59:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:10 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:59:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:59:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:59:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:59:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:59:30 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:59:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:59:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:59:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:59:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:59:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:59:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:59:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:59:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:59:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:59:40 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:45 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:59:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:59:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 00:59:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:59:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 00:59:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:46 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:59:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:59:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:59:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:59:46 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 00:59:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 00:59:47 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:59:47 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 00:59:47 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8876MB free_disk=25.19306182861328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 6dd25a67-f89b-48fb-972a-4d1098a2418e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 00:59:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:59:49 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:59:49 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:59:49 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 00:59:50 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:59:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 00:59:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:59:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:59:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:59:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:59:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:59:51 user nova-compute[70709]: INFO nova.compute.manager [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Terminating instance
Jul 28 00:59:51 user nova-compute[70709]: DEBUG nova.compute.manager [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-3a665db3-2799-46d3-8a43-103bae638fe4 req-2eb94705-75ea-45ef-824f-4d4970c316a4 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-vif-unplugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3a665db3-2799-46d3-8a43-103bae638fe4 req-2eb94705-75ea-45ef-824f-4d4970c316a4 service nova] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3a665db3-2799-46d3-8a43-103bae638fe4 req-2eb94705-75ea-45ef-824f-4d4970c316a4 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3a665db3-2799-46d3-8a43-103bae638fe4 req-2eb94705-75ea-45ef-824f-4d4970c316a4 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-3a665db3-2799-46d3-8a43-103bae638fe4 req-2eb94705-75ea-45ef-824f-4d4970c316a4 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] No waiting events found dispatching network-vif-unplugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-3a665db3-2799-46d3-8a43-103bae638fe4 req-2eb94705-75ea-45ef-824f-4d4970c316a4 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-vif-unplugged-6baec140-9c13-4795-94e7-19992ffba645 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Instance destroyed successfully.
Jul 28 00:59:52 user nova-compute[70709]: DEBUG nova.objects.instance [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'resources' on Instance uuid 6dd25a67-f89b-48fb-972a-4d1098a2418e {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T00:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620221260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620221260',id=49,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQucKfe6jIWE1eH7EoKoLkvCwj1BrAVMLYkVE8VU2PBF/S85mzI+jJTXyZ0aTHz8dM/okRzJ1/AVwE1jb+X9/G1I1IKxShrc2+6uWDJeTPWV8nqu6eavluWn/ZOdfcu9Q==',key_name='tempest-keypair-405379372',keypairs=<?>,launch_index=0,launched_at=2023-07-28T00:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-2ac8q871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T00:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=6dd25a67-f89b-48fb-972a-4d1098a2418e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "6baec140-9c13-4795-94e7-19992ffba645", "address": "fa:16:3e:9e:a1:90", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baec140-9c", "ovs_interfaceid": "6baec140-9c13-4795-94e7-19992ffba645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG os_vif [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6baec140-9c, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:52 user nova-compute[70709]: INFO os_vif [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a1:90,bridge_name='br-int',has_traffic_filtering=True,id=6baec140-9c13-4795-94e7-19992ffba645,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baec140-9c')
Jul 28 00:59:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Deleting instance files /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e_del
Jul 28 00:59:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Deletion of /opt/stack/data/nova/instances/6dd25a67-f89b-48fb-972a-4d1098a2418e_del complete
Jul 28 00:59:52 user nova-compute[70709]: INFO nova.compute.manager [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 28 00:59:52 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 00:59:52 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 00:59:53 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 00:59:53 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Took 1.02 seconds to deallocate network for instance.
Jul 28 00:59:53 user nova-compute[70709]: DEBUG nova.compute.manager [req-c17f75f2-2cb6-4c75-b094-ee0a51f0fd4b req-2079aa11-fb13-4534-a622-4f12c130fa14 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-vif-deleted-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:59:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:59:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:59:54 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 00:59:54 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 00:59:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:59:54 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Deleted allocations for instance 6dd25a67-f89b-48fb-972a-4d1098a2418e
Jul 28 00:59:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-3e1f35d3-da19-45f5-bcd5-087d3c17a934 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.296s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:59:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-f784d375-46a1-47e7-be10-2ac6d006ffa1 req-54b29250-c3cc-4dd7-a1b3-8cb83c72b061 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 00:59:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f784d375-46a1-47e7-be10-2ac6d006ffa1 req-54b29250-c3cc-4dd7-a1b3-8cb83c72b061 service nova] Acquiring lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 00:59:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f784d375-46a1-47e7-be10-2ac6d006ffa1 req-54b29250-c3cc-4dd7-a1b3-8cb83c72b061 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 00:59:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f784d375-46a1-47e7-be10-2ac6d006ffa1 req-54b29250-c3cc-4dd7-a1b3-8cb83c72b061 service nova] Lock "6dd25a67-f89b-48fb-972a-4d1098a2418e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 00:59:54 user nova-compute[70709]: DEBUG nova.compute.manager [req-f784d375-46a1-47e7-be10-2ac6d006ffa1 req-54b29250-c3cc-4dd7-a1b3-8cb83c72b061 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] No waiting events found dispatching network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 00:59:54 user nova-compute[70709]: WARNING nova.compute.manager [req-f784d375-46a1-47e7-be10-2ac6d006ffa1 req-54b29250-c3cc-4dd7-a1b3-8cb83c72b061 service nova] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Received unexpected event network-vif-plugged-6baec140-9c13-4795-94e7-19992ffba645 for instance with vm_state deleted and task_state None.
Jul 28 00:59:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 00:59:57 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 00:59:58 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:00:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:00:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:00:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:00:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:00:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:00:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:00:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:00:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:00:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 01:00:07 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690505992.757712, 6dd25a67-f89b-48fb-972a-4d1098a2418e => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:00:07 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] VM Stopped (Lifecycle Event)
Jul 28 01:00:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bc17e14c-3e0a-4060-9bbf-7b313ca2650d None None] [instance: 6dd25a67-f89b-48fb-972a-4d1098a2418e] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:00:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:00:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:00:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:00:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:00:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:00:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:00:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:00:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:00:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:00:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:00:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:00:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 01:00:46 user nova-compute[70709]: INFO nova.compute.claims [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Claim successful on node user
Jul 28 01:00:46 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG nova.network.neutron [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 01:00:46 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 01:00:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 01:00:46 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Creating image(s)
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "/opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "/opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "/opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG nova.policy [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bef098a320ff4116b6ea7cb12d6aa41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be36b20189ca4ac5880e2404b59f20dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.140s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "735092a584d39faa236d7ec43c68916467bd8025" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:00:46 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.130s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025,backing_fmt=raw /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk 1073741824" returned: 0 in 0.049s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "735092a584d39faa236d7ec43c68916467bd8025" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.134s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk. size=1073741824 {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG nova.virt.disk.api [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Cannot resize image /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk to a smaller size. {{(pid=70709) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG nova.objects.instance [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'migration_context' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Ensure instance console log exists: /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG nova.network.neutron [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Successfully created port: 1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:00:47 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:00:48 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:00:48 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=25.21965789794922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 76a928e1-468b-42fa-b517-aef8e8875a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.network.neutron [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Successfully updated port: 1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquired lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.network.neutron [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-5cfaf899-2c45-459f-978e-69f608a1601d req-e49209af-fafd-4bfb-ae0a-85432eea7b90 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-changed-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.compute.manager [req-5cfaf899-2c45-459f-978e-69f608a1601d req-e49209af-fafd-4bfb-ae0a-85432eea7b90 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Refreshing instance network info cache due to event network-changed-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5cfaf899-2c45-459f-978e-69f608a1601d req-e49209af-fafd-4bfb-ae0a-85432eea7b90 service nova] Acquiring lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.network.neutron [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.network.neutron [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Releasing lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.compute.manager [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Instance network_info: |[{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5cfaf899-2c45-459f-978e-69f608a1601d req-e49209af-fafd-4bfb-ae0a-85432eea7b90 service nova] Acquired lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.network.neutron [req-5cfaf899-2c45-459f-978e-69f608a1601d req-e49209af-fafd-4bfb-ae0a-85432eea7b90 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Refreshing network info cache for port 1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Start _get_guest_xml network_info=[{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 01:00:48 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:00:48 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-28T00:10:35Z,direct_url=<?>,disk_format='qcow2',id=51efbb04-1b4c-43c9-99e8-6467b05b27ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dfaa8247d31a480f99168e883a0b1888',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-28T00:10:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T01:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1718227989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1718227989',id=50,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXn2FXN3MfBu2RspTmKfGv/RyIazRNjCnMgvETWMYIdkW0VqqwC5tcd8+tWCf4q3t0ocbvVlNTlCsdfvmzoiM05nTTK16xJgWQ0qTX3xNGz4Rr9nlOaTVz/A/+HXSm1ew==',key_name='tempest-keypair-1807857457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-ztr04rox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T01:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=76a928e1-468b-42fa-b517-aef8e8875a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.objects.instance [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'pci_devices' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] End _get_guest_xml xml=<domain type="kvm">
Jul 28 01:00:48 user nova-compute[70709]:   <uuid>76a928e1-468b-42fa-b517-aef8e8875a1d</uuid>
Jul 28 01:00:48 user nova-compute[70709]:   <name>instance-00000032</name>
Jul 28 01:00:48 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 01:00:48 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 01:00:48 user nova-compute[70709]:   <metadata>
Jul 28 01:00:48 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 01:00:48 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 01:00:48 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1718227989</nova:name>
Jul 28 01:00:48 user nova-compute[70709]:       <nova:creationTime>2023-07-28 01:00:48</nova:creationTime>
Jul 28 01:00:48 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 01:00:48 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 01:00:48 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 01:00:48 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 01:00:48 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 01:00:48 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 01:00:48 user nova-compute[70709]:       </nova:flavor>
Jul 28 01:00:48 user nova-compute[70709]:       <nova:owner>
Jul 28 01:00:48 user nova-compute[70709]:         <nova:user uuid="bef098a320ff4116b6ea7cb12d6aa41a">tempest-AttachVolumeShelveTestJSON-2054382732-project-member</nova:user>
Jul 28 01:00:48 user nova-compute[70709]:         <nova:project uuid="be36b20189ca4ac5880e2404b59f20dc">tempest-AttachVolumeShelveTestJSON-2054382732</nova:project>
Jul 28 01:00:48 user nova-compute[70709]:       </nova:owner>
Jul 28 01:00:48 user nova-compute[70709]:       <nova:root type="image" uuid="51efbb04-1b4c-43c9-99e8-6467b05b27ad"/>
Jul 28 01:00:48 user nova-compute[70709]:       <nova:ports>
Jul 28 01:00:48 user nova-compute[70709]:         <nova:port uuid="1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4">
Jul 28 01:00:48 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 28 01:00:48 user nova-compute[70709]:         </nova:port>
Jul 28 01:00:48 user nova-compute[70709]:       </nova:ports>
Jul 28 01:00:48 user nova-compute[70709]:     </nova:instance>
Jul 28 01:00:48 user nova-compute[70709]:   </metadata>
Jul 28 01:00:48 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 01:00:48 user nova-compute[70709]:     <system>
Jul 28 01:00:48 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 01:00:48 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 01:00:48 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 01:00:48 user nova-compute[70709]:       <entry name="serial">76a928e1-468b-42fa-b517-aef8e8875a1d</entry>
Jul 28 01:00:48 user nova-compute[70709]:       <entry name="uuid">76a928e1-468b-42fa-b517-aef8e8875a1d</entry>
Jul 28 01:00:48 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 01:00:48 user nova-compute[70709]:     </system>
Jul 28 01:00:48 user nova-compute[70709]:   </sysinfo>
Jul 28 01:00:48 user nova-compute[70709]:   <os>
Jul 28 01:00:48 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 01:00:48 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 01:00:48 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 01:00:48 user nova-compute[70709]:   </os>
Jul 28 01:00:48 user nova-compute[70709]:   <features>
Jul 28 01:00:48 user nova-compute[70709]:     <acpi/>
Jul 28 01:00:48 user nova-compute[70709]:     <apic/>
Jul 28 01:00:48 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 01:00:48 user nova-compute[70709]:   </features>
Jul 28 01:00:48 user nova-compute[70709]:   <clock offset="utc">
Jul 28 01:00:48 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 01:00:48 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 01:00:48 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 01:00:48 user nova-compute[70709]:   </clock>
Jul 28 01:00:48 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 01:00:48 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 01:00:48 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 01:00:48 user nova-compute[70709]:   </cpu>
Jul 28 01:00:48 user nova-compute[70709]:   <devices>
Jul 28 01:00:48 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 01:00:48 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 01:00:48 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk"/>
Jul 28 01:00:48 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 01:00:48 user nova-compute[70709]:     </disk>
Jul 28 01:00:48 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 01:00:48 user nova-compute[70709]:       <mac address="fa:16:3e:e3:30:a4"/>
Jul 28 01:00:48 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 01:00:48 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 01:00:48 user nova-compute[70709]:       <target dev="tap1b5f6a90-9c"/>
Jul 28 01:00:48 user nova-compute[70709]:     </interface>
Jul 28 01:00:48 user nova-compute[70709]:     <serial type="pty">
Jul 28 01:00:48 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/console.log" append="off"/>
Jul 28 01:00:48 user nova-compute[70709]:     </serial>
Jul 28 01:00:48 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 01:00:48 user nova-compute[70709]:     <video>
Jul 28 01:00:48 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 01:00:48 user nova-compute[70709]:     </video>
Jul 28 01:00:48 user nova-compute[70709]:     <rng model="virtio">
Jul 28 01:00:48 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 01:00:48 user nova-compute[70709]:     </rng>
Jul 28 01:00:48 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 01:00:48 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 01:00:48 user nova-compute[70709]:       <stats period="10"/>
Jul 28 01:00:48 user nova-compute[70709]:     </memballoon>
Jul 28 01:00:48 user nova-compute[70709]:   </devices>
Jul 28 01:00:48 user nova-compute[70709]: </domain>
Jul 28 01:00:48 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T01:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1718227989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1718227989',id=50,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXn2FXN3MfBu2RspTmKfGv/RyIazRNjCnMgvETWMYIdkW0VqqwC5tcd8+tWCf4q3t0ocbvVlNTlCsdfvmzoiM05nTTK16xJgWQ0qTX3xNGz4Rr9nlOaTVz/A/+HXSm1ew==',key_name='tempest-keypair-1807857457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-ztr04rox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T01:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=76a928e1-468b-42fa-b517-aef8e8875a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG os_vif [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b5f6a90-9c, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b5f6a90-9c, col_values=(('external_ids', {'iface-id': '1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:30:a4', 'vm-uuid': '76a928e1-468b-42fa-b517-aef8e8875a1d'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:48 user nova-compute[70709]: INFO os_vif [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c')
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 01:00:48 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] No VIF found with MAC fa:16:3e:e3:30:a4, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 01:00:49 user nova-compute[70709]: DEBUG nova.network.neutron [req-5cfaf899-2c45-459f-978e-69f608a1601d req-e49209af-fafd-4bfb-ae0a-85432eea7b90 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updated VIF entry in instance network info cache for port 1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 01:00:49 user nova-compute[70709]: DEBUG nova.network.neutron [req-5cfaf899-2c45-459f-978e-69f608a1601d req-e49209af-fafd-4bfb-ae0a-85432eea7b90 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:00:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5cfaf899-2c45-459f-978e-69f608a1601d req-e49209af-fafd-4bfb-ae0a-85432eea7b90 service nova] Releasing lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-1e1dd5ab-5501-40c0-b349-dbeeae216910 req-03a7c578-5de0-4e2e-9d6c-6a2f352d7ba8 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1e1dd5ab-5501-40c0-b349-dbeeae216910 req-03a7c578-5de0-4e2e-9d6c-6a2f352d7ba8 service nova] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1e1dd5ab-5501-40c0-b349-dbeeae216910 req-03a7c578-5de0-4e2e-9d6c-6a2f352d7ba8 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-1e1dd5ab-5501-40c0-b349-dbeeae216910 req-03a7c578-5de0-4e2e-9d6c-6a2f352d7ba8 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG nova.compute.manager [req-1e1dd5ab-5501-40c0-b349-dbeeae216910 req-03a7c578-5de0-4e2e-9d6c-6a2f352d7ba8 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] No waiting events found dispatching network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:00:50 user nova-compute[70709]: WARNING nova.compute.manager [req-1e1dd5ab-5501-40c0-b349-dbeeae216910 req-03a7c578-5de0-4e2e-9d6c-6a2f352d7ba8 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received unexpected event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 for instance with vm_state building and task_state spawning.
Jul 28 01:00:50 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:51 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690506052.3421128, 76a928e1-468b-42fa-b517-aef8e8875a1d => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:00:52 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] VM Resumed (Lifecycle Event)
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 01:00:52 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Instance spawned successfully.
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:00:52 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690506052.3441398, 76a928e1-468b-42fa-b517-aef8e8875a1d => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:00:52 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] VM Started (Lifecycle Event)
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 01:00:52 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-36427877-d030-4aa3-8df8-a23c5505c6c7 req-d31c2f4e-c6a2-41f1-96b7-fb1a117250b3 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-36427877-d030-4aa3-8df8-a23c5505c6c7 req-d31c2f4e-c6a2-41f1-96b7-fb1a117250b3 service nova] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-36427877-d030-4aa3-8df8-a23c5505c6c7 req-d31c2f4e-c6a2-41f1-96b7-fb1a117250b3 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-36427877-d030-4aa3-8df8-a23c5505c6c7 req-d31c2f4e-c6a2-41f1-96b7-fb1a117250b3 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.compute.manager [req-36427877-d030-4aa3-8df8-a23c5505c6c7 req-d31c2f4e-c6a2-41f1-96b7-fb1a117250b3 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] No waiting events found dispatching network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:00:52 user nova-compute[70709]: WARNING nova.compute.manager [req-36427877-d030-4aa3-8df8-a23c5505c6c7 req-d31c2f4e-c6a2-41f1-96b7-fb1a117250b3 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received unexpected event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 for instance with vm_state building and task_state spawning.
Jul 28 01:00:52 user nova-compute[70709]: INFO nova.compute.manager [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Took 5.82 seconds to spawn the instance on the hypervisor.
Jul 28 01:00:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:00:52 user nova-compute[70709]: INFO nova.compute.manager [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Took 6.39 seconds to build instance.
Jul 28 01:00:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-96720198-3671-487e-bc3b-e3a2ed0febd7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.487s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:00:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:55 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:00:55 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 01:00:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:00:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:00:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:00:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:00:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:00:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:00:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:00:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:00:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:00:59 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:00:59 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:00:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 01:01:00 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:01:02 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:01:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:01:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:01:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:01:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:01:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:05 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:01:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:01:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:01:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:01:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:01:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:01:06 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 01:01:06 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:01:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:01:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:01:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 01:01:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:01:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 01:01:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 01:01:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:27 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:01:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:01:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:01:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:01:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:01:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:01:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:01:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:01:47 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:01:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:01:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:01:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:01:47 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:01:47 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:01:48 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:01:48 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:01:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8863MB free_disk=25.1905517578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 76a928e1-468b-42fa-b517-aef8e8875a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:01:48 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:01:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:01:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:01:49 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:01:51 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:01:51 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:01:52 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:01:53 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:01:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:01:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:01:59 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:02:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:02:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:02:04 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:02:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:02:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:02:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:02:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:02:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:02:07 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 01:02:07 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:02:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:02:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:02:08 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 01:02:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:02:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:02:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:02:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:02:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:02:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:02:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:02:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:02:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:02:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:02:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:02:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:02:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:02:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:02:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:02:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:02:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:02:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:02:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:37 user nova-compute[70709]: DEBUG nova.compute.manager [req-dd3e6525-6359-4a8c-8cbb-8a4f5625d6d7 req-a2b4f564-f6d8-4b6b-af3f-a15fba16199d service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-changed-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:02:37 user nova-compute[70709]: DEBUG nova.compute.manager [req-dd3e6525-6359-4a8c-8cbb-8a4f5625d6d7 req-a2b4f564-f6d8-4b6b-af3f-a15fba16199d service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Refreshing instance network info cache due to event network-changed-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 01:02:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dd3e6525-6359-4a8c-8cbb-8a4f5625d6d7 req-a2b4f564-f6d8-4b6b-af3f-a15fba16199d service nova] Acquiring lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:02:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dd3e6525-6359-4a8c-8cbb-8a4f5625d6d7 req-a2b4f564-f6d8-4b6b-af3f-a15fba16199d service nova] Acquired lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:02:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-dd3e6525-6359-4a8c-8cbb-8a4f5625d6d7 req-a2b4f564-f6d8-4b6b-af3f-a15fba16199d service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Refreshing network info cache for port 1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 01:02:38 user nova-compute[70709]: DEBUG nova.network.neutron [req-dd3e6525-6359-4a8c-8cbb-8a4f5625d6d7 req-a2b4f564-f6d8-4b6b-af3f-a15fba16199d service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updated VIF entry in instance network info cache for port 1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 01:02:38 user nova-compute[70709]: DEBUG nova.network.neutron [req-dd3e6525-6359-4a8c-8cbb-8a4f5625d6d7 req-a2b4f564-f6d8-4b6b-af3f-a15fba16199d service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:02:38 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-dd3e6525-6359-4a8c-8cbb-8a4f5625d6d7 req-a2b4f564-f6d8-4b6b-af3f-a15fba16199d service nova] Releasing lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:02:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:02:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:02:42 user nova-compute[70709]: INFO nova.compute.manager [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Shelving
Jul 28 01:02:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-0f7d6eae-8a04-4bc7-ae14-c398ca4910cc req-30d053d1-7b8d-4a4c-b2d0-9a04d5e97592 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-vif-unplugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:02:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0f7d6eae-8a04-4bc7-ae14-c398ca4910cc req-30d053d1-7b8d-4a4c-b2d0-9a04d5e97592 service nova] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:02:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0f7d6eae-8a04-4bc7-ae14-c398ca4910cc req-30d053d1-7b8d-4a4c-b2d0-9a04d5e97592 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:02:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0f7d6eae-8a04-4bc7-ae14-c398ca4910cc req-30d053d1-7b8d-4a4c-b2d0-9a04d5e97592 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:02:42 user nova-compute[70709]: DEBUG nova.compute.manager [req-0f7d6eae-8a04-4bc7-ae14-c398ca4910cc req-30d053d1-7b8d-4a4c-b2d0-9a04d5e97592 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] No waiting events found dispatching network-vif-unplugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:02:42 user nova-compute[70709]: WARNING nova.compute.manager [req-0f7d6eae-8a04-4bc7-ae14-c398ca4910cc req-30d053d1-7b8d-4a4c-b2d0-9a04d5e97592 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received unexpected event network-vif-unplugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 for instance with vm_state active and task_state shelving.
Jul 28 01:02:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:43 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Instance destroyed successfully.
Jul 28 01:02:43 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Beginning cold snapshot process
Jul 28 01:02:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:43 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 01:02:43 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk /opt/stack/data/nova/instances/snapshots/tmphwv5i6er/e9f44fea5178456c86e63bc62bb6d56a {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:02:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:44 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk /opt/stack/data/nova/instances/snapshots/tmphwv5i6er/e9f44fea5178456c86e63bc62bb6d56a" returned: 0 in 0.584s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:02:44 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Snapshot extracted, beginning image upload
Jul 28 01:02:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-207af78d-3f30-474e-81f9-99a67d0dd4fb req-86485e04-d13d-4f5a-b417-729c6c83d9b1 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:02:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-207af78d-3f30-474e-81f9-99a67d0dd4fb req-86485e04-d13d-4f5a-b417-729c6c83d9b1 service nova] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:02:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-207af78d-3f30-474e-81f9-99a67d0dd4fb req-86485e04-d13d-4f5a-b417-729c6c83d9b1 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:02:45 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-207af78d-3f30-474e-81f9-99a67d0dd4fb req-86485e04-d13d-4f5a-b417-729c6c83d9b1 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:02:45 user nova-compute[70709]: DEBUG nova.compute.manager [req-207af78d-3f30-474e-81f9-99a67d0dd4fb req-86485e04-d13d-4f5a-b417-729c6c83d9b1 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] No waiting events found dispatching network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:02:45 user nova-compute[70709]: WARNING nova.compute.manager [req-207af78d-3f30-474e-81f9-99a67d0dd4fb req-86485e04-d13d-4f5a-b417-729c6c83d9b1 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received unexpected event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 for instance with vm_state active and task_state shelving_image_uploading.
Jul 28 01:02:46 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Snapshot image upload complete
Jul 28 01:02:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:02:46 user nova-compute[70709]: INFO nova.compute.manager [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Shelve offloading
Jul 28 01:02:46 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Instance destroyed successfully.
Jul 28 01:02:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:02:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:02:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquired lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:02:46 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG nova.network.neutron [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Releasing lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:02:47 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Instance destroyed successfully.
Jul 28 01:02:47 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'resources' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T01:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1718227989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1718227989',id=50,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXn2FXN3MfBu2RspTmKfGv/RyIazRNjCnMgvETWMYIdkW0VqqwC5tcd8+tWCf4q3t0ocbvVlNTlCsdfvmzoiM05nTTK16xJgWQ0qTX3xNGz4Rr9nlOaTVz/A/+HXSm1ew==',key_name='tempest-keypair-1807857457',keypairs=<?>,launch_index=0,launched_at=2023-07-28T01:00:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-ztr04rox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member',shelved_at='2023-07-28T01:02:46.464952',shelved_host='user',shelved_image_id='d5272cdf-7344-41bc-b69c-1ab82353e8c6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T01:02:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=76a928e1-468b-42fa-b517-aef8e8875a1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG os_vif [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b5f6a90-9c, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:02:47 user nova-compute[70709]: INFO os_vif [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c')
Jul 28 01:02:47 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Deleting instance files /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d_del
Jul 28 01:02:47 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Deletion of /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d_del complete
Jul 28 01:02:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-6c4fe6b2-9709-4fb2-a72d-765f62730a08 req-4361a9e3-84dd-415e-a18a-492fdef595d3 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-changed-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG nova.compute.manager [req-6c4fe6b2-9709-4fb2-a72d-765f62730a08 req-4361a9e3-84dd-415e-a18a-492fdef595d3 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Refreshing instance network info cache due to event network-changed-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6c4fe6b2-9709-4fb2-a72d-765f62730a08 req-4361a9e3-84dd-415e-a18a-492fdef595d3 service nova] Acquiring lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6c4fe6b2-9709-4fb2-a72d-765f62730a08 req-4361a9e3-84dd-415e-a18a-492fdef595d3 service nova] Acquired lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:02:47 user nova-compute[70709]: DEBUG nova.network.neutron [req-6c4fe6b2-9709-4fb2-a72d-765f62730a08 req-4361a9e3-84dd-415e-a18a-492fdef595d3 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Refreshing network info cache for port 1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 01:02:47 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Deleted allocations for instance 76a928e1-468b-42fa-b517-aef8e8875a1d
Jul 28 01:02:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG nova.objects.instance [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'numa_topology' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-9230c6d4-e2f3-4f84-a805-6d1927f49133 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.582s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG nova.network.neutron [req-6c4fe6b2-9709-4fb2-a72d-765f62730a08 req-4361a9e3-84dd-415e-a18a-492fdef595d3 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updated VIF entry in instance network info cache for port 1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG nova.network.neutron [req-6c4fe6b2-9709-4fb2-a72d-765f62730a08 req-4361a9e3-84dd-415e-a18a-492fdef595d3 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6c4fe6b2-9709-4fb2-a72d-765f62730a08 req-4361a9e3-84dd-415e-a18a-492fdef595d3 service nova] Releasing lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:02:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:02:49 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:02:49 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:02:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=25.168766021728516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:02:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:02:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:02:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:02:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:02:49 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:02:49 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:02:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:02:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:02:51 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:02:52 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:02:52 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:02:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:02:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:54 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:02:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:02:58 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690506163.4308963, 76a928e1-468b-42fa-b517-aef8e8875a1d => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:02:58 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] VM Stopped (Lifecycle Event)
Jul 28 01:02:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-d59bdefe-637e-4419-aa33-f8dfea329d91 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:02:59 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:03:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:03:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:03:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:03:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:03:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:03:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:03:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 01:03:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:03:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:03:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:03:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:03:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:03:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:03:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:03:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:03:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:03:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:03:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:03:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:03:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:03:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:03:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:03:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:03:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:03:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:03:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:03:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:03:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:03:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:03:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:03:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:03:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:03:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:03:49 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:03:49 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:03:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=25.168182373046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:03:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:03:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:03:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:03:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:03:49 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:03:49 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:03:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:03:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:03:52 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:03:52 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:03:52 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:03:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:03:53 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:03:56 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:03:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:04:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:04:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:04:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:04:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:04:07 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 01:04:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:04:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:04:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:04:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:04:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:04:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:04:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:04:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:04:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:04:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:04:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:04:35 user nova-compute[70709]: INFO nova.compute.manager [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Unshelving
Jul 28 01:04:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:04:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:04:35 user nova-compute[70709]: DEBUG nova.objects.instance [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'pci_requests' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:04:35 user nova-compute[70709]: DEBUG nova.objects.instance [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'numa_topology' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:04:35 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 01:04:35 user nova-compute[70709]: INFO nova.compute.claims [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Claim successful on node user
Jul 28 01:04:35 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:04:35 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:04:35 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.191s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:04:35 user nova-compute[70709]: INFO nova.network.neutron [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating port 1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 28 01:04:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:04:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquired lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:04:36 user nova-compute[70709]: DEBUG nova.network.neutron [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 01:04:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-b70a4195-5995-451e-9edb-98c18a5a5176 req-c0139366-1bc0-461a-93fd-5eacd44a3642 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-changed-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:04:36 user nova-compute[70709]: DEBUG nova.compute.manager [req-b70a4195-5995-451e-9edb-98c18a5a5176 req-c0139366-1bc0-461a-93fd-5eacd44a3642 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Refreshing instance network info cache due to event network-changed-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 01:04:36 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b70a4195-5995-451e-9edb-98c18a5a5176 req-c0139366-1bc0-461a-93fd-5eacd44a3642 service nova] Acquiring lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:04:37 user nova-compute[70709]: DEBUG nova.network.neutron [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:04:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Releasing lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:04:37 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 01:04:37 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Creating image(s)
Jul 28 01:04:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "/opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:04:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "/opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:04:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "/opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:04:37 user nova-compute[70709]: DEBUG nova.objects.instance [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:04:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b70a4195-5995-451e-9edb-98c18a5a5176 req-c0139366-1bc0-461a-93fd-5eacd44a3642 service nova] Acquired lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:04:37 user nova-compute[70709]: DEBUG nova.network.neutron [req-b70a4195-5995-451e-9edb-98c18a5a5176 req-c0139366-1bc0-461a-93fd-5eacd44a3642 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Refreshing network info cache for port 1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 01:04:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "b609bcd6aef1303a022679ce344e03e164d2e0e7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:04:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "b609bcd6aef1303a022679ce344e03e164d2e0e7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:04:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7.part --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:04:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7.part --force-share --output=json" returned: 0 in 0.157s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:04:38 user nova-compute[70709]: DEBUG nova.virt.images [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] d5272cdf-7344-41bc-b69c-1ab82353e8c6 was qcow2, converting to raw {{(pid=70709) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 28 01:04:38 user nova-compute[70709]: DEBUG nova.privsep.utils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70709) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 28 01:04:38 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7.part /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7.converted {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG nova.network.neutron [req-b70a4195-5995-451e-9edb-98c18a5a5176 req-c0139366-1bc0-461a-93fd-5eacd44a3642 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updated VIF entry in instance network info cache for port 1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG nova.network.neutron [req-b70a4195-5995-451e-9edb-98c18a5a5176 req-c0139366-1bc0-461a-93fd-5eacd44a3642 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b70a4195-5995-451e-9edb-98c18a5a5176 req-c0139366-1bc0-461a-93fd-5eacd44a3642 service nova] Releasing lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7.part /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7.converted" returned: 0 in 0.586s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7.converted --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "b609bcd6aef1303a022679ce344e03e164d2e0e7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.932s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7 --force-share --output=json" returned: 0 in 0.147s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "b609bcd6aef1303a022679ce344e03e164d2e0e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "b609bcd6aef1303a022679ce344e03e164d2e0e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:04:39 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:04:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7 --force-share --output=json" returned: 0 in 0.173s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:04:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7,backing_fmt=raw /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk 1073741824 {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:04:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7,backing_fmt=raw /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk 1073741824" returned: 0 in 0.129s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:04:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "b609bcd6aef1303a022679ce344e03e164d2e0e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:04:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:04:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b609bcd6aef1303a022679ce344e03e164d2e0e7 --force-share --output=json" returned: 0 in 0.163s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:04:40 user nova-compute[70709]: DEBUG nova.objects.instance [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'migration_context' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:04:40 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Rebasing disk image.
Jul 28 01:04:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:04:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 --force-share --output=json" returned: 0 in 0.133s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:04:40 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 -F raw /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/735092a584d39faa236d7ec43c68916467bd8025 -F raw /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk" returned: 0 in 2.256s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Created local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Ensure instance console log exists: /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Start _get_guest_xml network_info=[{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ad26df490e41978976e823acba77b63e',container_format='bare',created_at=2023-07-28T01:02:42Z,direct_url=<?>,disk_format='qcow2',id=d5272cdf-7344-41bc-b69c-1ab82353e8c6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1718227989-shelved',owner='be36b20189ca4ac5880e2404b59f20dc',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-28T01:02:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '51efbb04-1b4c-43c9-99e8-6467b05b27ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 01:04:42 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:04:42 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ad26df490e41978976e823acba77b63e',container_format='bare',created_at=2023-07-28T01:02:42Z,direct_url=<?>,disk_format='qcow2',id=d5272cdf-7344-41bc-b69c-1ab82353e8c6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1718227989-shelved',owner='be36b20189ca4ac5880e2404b59f20dc',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-28T01:02:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.objects.instance [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T01:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1718227989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1718227989',id=50,image_ref='d5272cdf-7344-41bc-b69c-1ab82353e8c6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1807857457',keypairs=<?>,launch_index=0,launched_at=2023-07-28T01:00:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-ztr04rox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member',shelved_at='2023-07-28T01:02:46.464952',shelved_host='user',shelved_image_id='d5272cdf-7344-41bc-b69c-1ab82353e8c6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T01:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=76a928e1-468b-42fa-b517-aef8e8875a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.objects.instance [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'pci_devices' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] End _get_guest_xml xml=<domain type="kvm">
Jul 28 01:04:42 user nova-compute[70709]:   <uuid>76a928e1-468b-42fa-b517-aef8e8875a1d</uuid>
Jul 28 01:04:42 user nova-compute[70709]:   <name>instance-00000032</name>
Jul 28 01:04:42 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 01:04:42 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 01:04:42 user nova-compute[70709]:   <metadata>
Jul 28 01:04:42 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 01:04:42 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 01:04:42 user nova-compute[70709]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1718227989</nova:name>
Jul 28 01:04:42 user nova-compute[70709]:       <nova:creationTime>2023-07-28 01:04:42</nova:creationTime>
Jul 28 01:04:42 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 01:04:42 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 01:04:42 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 01:04:42 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 01:04:42 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 01:04:42 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 01:04:42 user nova-compute[70709]:       </nova:flavor>
Jul 28 01:04:42 user nova-compute[70709]:       <nova:owner>
Jul 28 01:04:42 user nova-compute[70709]:         <nova:user uuid="bef098a320ff4116b6ea7cb12d6aa41a">tempest-AttachVolumeShelveTestJSON-2054382732-project-member</nova:user>
Jul 28 01:04:42 user nova-compute[70709]:         <nova:project uuid="be36b20189ca4ac5880e2404b59f20dc">tempest-AttachVolumeShelveTestJSON-2054382732</nova:project>
Jul 28 01:04:42 user nova-compute[70709]:       </nova:owner>
Jul 28 01:04:42 user nova-compute[70709]:       <nova:root type="image" uuid="d5272cdf-7344-41bc-b69c-1ab82353e8c6"/>
Jul 28 01:04:42 user nova-compute[70709]:       <nova:ports>
Jul 28 01:04:42 user nova-compute[70709]:         <nova:port uuid="1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4">
Jul 28 01:04:42 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 28 01:04:42 user nova-compute[70709]:         </nova:port>
Jul 28 01:04:42 user nova-compute[70709]:       </nova:ports>
Jul 28 01:04:42 user nova-compute[70709]:     </nova:instance>
Jul 28 01:04:42 user nova-compute[70709]:   </metadata>
Jul 28 01:04:42 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 01:04:42 user nova-compute[70709]:     <system>
Jul 28 01:04:42 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 01:04:42 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 01:04:42 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 01:04:42 user nova-compute[70709]:       <entry name="serial">76a928e1-468b-42fa-b517-aef8e8875a1d</entry>
Jul 28 01:04:42 user nova-compute[70709]:       <entry name="uuid">76a928e1-468b-42fa-b517-aef8e8875a1d</entry>
Jul 28 01:04:42 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 01:04:42 user nova-compute[70709]:     </system>
Jul 28 01:04:42 user nova-compute[70709]:   </sysinfo>
Jul 28 01:04:42 user nova-compute[70709]:   <os>
Jul 28 01:04:42 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 01:04:42 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 01:04:42 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 01:04:42 user nova-compute[70709]:   </os>
Jul 28 01:04:42 user nova-compute[70709]:   <features>
Jul 28 01:04:42 user nova-compute[70709]:     <acpi/>
Jul 28 01:04:42 user nova-compute[70709]:     <apic/>
Jul 28 01:04:42 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 01:04:42 user nova-compute[70709]:   </features>
Jul 28 01:04:42 user nova-compute[70709]:   <clock offset="utc">
Jul 28 01:04:42 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 01:04:42 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 01:04:42 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 01:04:42 user nova-compute[70709]:   </clock>
Jul 28 01:04:42 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 01:04:42 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 01:04:42 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 01:04:42 user nova-compute[70709]:   </cpu>
Jul 28 01:04:42 user nova-compute[70709]:   <devices>
Jul 28 01:04:42 user nova-compute[70709]:     <disk type="file" device="disk">
Jul 28 01:04:42 user nova-compute[70709]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 28 01:04:42 user nova-compute[70709]:       <source file="/opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk"/>
Jul 28 01:04:42 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 01:04:42 user nova-compute[70709]:     </disk>
Jul 28 01:04:42 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 01:04:42 user nova-compute[70709]:       <mac address="fa:16:3e:e3:30:a4"/>
Jul 28 01:04:42 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 01:04:42 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 01:04:42 user nova-compute[70709]:       <target dev="tap1b5f6a90-9c"/>
Jul 28 01:04:42 user nova-compute[70709]:     </interface>
Jul 28 01:04:42 user nova-compute[70709]:     <serial type="pty">
Jul 28 01:04:42 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/console.log" append="off"/>
Jul 28 01:04:42 user nova-compute[70709]:     </serial>
Jul 28 01:04:42 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 01:04:42 user nova-compute[70709]:     <video>
Jul 28 01:04:42 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 01:04:42 user nova-compute[70709]:     </video>
Jul 28 01:04:42 user nova-compute[70709]:     <rng model="virtio">
Jul 28 01:04:42 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 01:04:42 user nova-compute[70709]:     </rng>
Jul 28 01:04:42 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 01:04:42 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 01:04:42 user nova-compute[70709]:       <stats period="10"/>
Jul 28 01:04:42 user nova-compute[70709]:     </memballoon>
Jul 28 01:04:42 user nova-compute[70709]:   </devices>
Jul 28 01:04:42 user nova-compute[70709]: </domain>
Jul 28 01:04:42 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T01:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1718227989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1718227989',id=50,image_ref='d5272cdf-7344-41bc-b69c-1ab82353e8c6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1807857457',keypairs=<?>,launch_index=0,launched_at=2023-07-28T01:00:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-ztr04rox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member',shelved_at='2023-07-28T01:02:46.464952',shelved_host='user',shelved_image_id='d5272cdf-7344-41bc-b69c-1ab82353e8c6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T01:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=76a928e1-468b-42fa-b517-aef8e8875a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG os_vif [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:04:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 01:04:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b5f6a90-9c, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:04:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b5f6a90-9c, col_values=(('external_ids', {'iface-id': '1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:30:a4', 'vm-uuid': '76a928e1-468b-42fa-b517-aef8e8875a1d'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:04:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:04:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:43 user nova-compute[70709]: INFO os_vif [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c')
Jul 28 01:04:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 01:04:43 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] No VIF found with MAC fa:16:3e:e3:30:a4, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 01:04:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-354a9f92-97e6-4855-a44d-3ec4fdac6617 req-77b7e663-724e-4150-96fe-5e7f7485eb7e service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:04:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-354a9f92-97e6-4855-a44d-3ec4fdac6617 req-77b7e663-724e-4150-96fe-5e7f7485eb7e service nova] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:04:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-354a9f92-97e6-4855-a44d-3ec4fdac6617 req-77b7e663-724e-4150-96fe-5e7f7485eb7e service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:04:44 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-354a9f92-97e6-4855-a44d-3ec4fdac6617 req-77b7e663-724e-4150-96fe-5e7f7485eb7e service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:04:44 user nova-compute[70709]: DEBUG nova.compute.manager [req-354a9f92-97e6-4855-a44d-3ec4fdac6617 req-77b7e663-724e-4150-96fe-5e7f7485eb7e service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] No waiting events found dispatching network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:04:44 user nova-compute[70709]: WARNING nova.compute.manager [req-354a9f92-97e6-4855-a44d-3ec4fdac6617 req-77b7e663-724e-4150-96fe-5e7f7485eb7e service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received unexpected event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 28 01:04:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:45 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:46 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690506286.7087457, 76a928e1-468b-42fa-b517-aef8e8875a1d => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:04:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] VM Resumed (Lifecycle Event)
Jul 28 01:04:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 01:04:46 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 01:04:46 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Instance spawned successfully.
Jul 28 01:04:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:04:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 01:04:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 01:04:46 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690506286.710639, 76a928e1-468b-42fa-b517-aef8e8875a1d => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:04:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] VM Started (Lifecycle Event)
Jul 28 01:04:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:04:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 01:04:46 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 01:04:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-cd0c588c-f783-4935-a9d8-4b2c3a3bb465 req-071d8552-3bee-40a7-b1dc-6d6cec56484d service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:04:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cd0c588c-f783-4935-a9d8-4b2c3a3bb465 req-071d8552-3bee-40a7-b1dc-6d6cec56484d service nova] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:04:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cd0c588c-f783-4935-a9d8-4b2c3a3bb465 req-071d8552-3bee-40a7-b1dc-6d6cec56484d service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:04:46 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-cd0c588c-f783-4935-a9d8-4b2c3a3bb465 req-071d8552-3bee-40a7-b1dc-6d6cec56484d service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:04:46 user nova-compute[70709]: DEBUG nova.compute.manager [req-cd0c588c-f783-4935-a9d8-4b2c3a3bb465 req-071d8552-3bee-40a7-b1dc-6d6cec56484d service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] No waiting events found dispatching network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:04:46 user nova-compute[70709]: WARNING nova.compute.manager [req-cd0c588c-f783-4935-a9d8-4b2c3a3bb465 req-071d8552-3bee-40a7-b1dc-6d6cec56484d service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received unexpected event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 28 01:04:46 user nova-compute[70709]: DEBUG nova.compute.manager [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:04:47 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-36663f3a-d57f-4aaf-86f0-60fc4d48d299 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.374s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:04:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:04:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:04:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:04:48 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:04:48 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:04:48 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:04:49 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:04:49 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:04:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8932MB free_disk=25.142093658447266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 76a928e1-468b-42fa-b517-aef8e8875a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:04:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:04:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:54 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:04:54 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:04:54 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:04:54 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:04:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:04:58 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:05:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:05:02 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:05:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:05:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:05:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:05:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:05:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:05:08 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:05:08 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:05:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:05:08 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:05:08 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 01:05:08 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:05:09 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:05:09 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:05:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 01:05:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:05:12 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:05:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:05:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:05:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:05:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:05:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:05:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:05:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:05:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:05:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:05:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:05:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:05:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:49 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:05:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:05:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:05:49 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:05:49 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:05:49 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:05:50 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:05:50 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:05:50 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=25.141273498535156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 76a928e1-468b-42fa-b517-aef8e8875a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:05:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:05:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:05:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:05:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:05:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:05:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:56 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:05:56 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:05:56 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:05:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:05:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:05:58 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:02 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:02 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:06:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:06:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:06:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:06:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:06:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:06:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:06:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:06:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:06:09 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:06:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:06:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:06:10 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 01:06:10 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:06:10 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [{"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:06:10 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-76a928e1-468b-42fa-b517-aef8e8875a1d" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:06:10 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 01:06:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 01:06:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:06:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:06:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:06:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:06:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:06:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:06:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:06:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:06:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:06:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:06:25 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:06:25 user nova-compute[70709]: INFO nova.compute.manager [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Terminating instance
Jul 28 01:06:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 01:06:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:25 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG nova.compute.manager [req-b6f4865c-aef1-4070-9196-870d326ee640 req-fff07c63-7b7b-4dc0-b60e-b57f1a90dee6 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-vif-unplugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b6f4865c-aef1-4070-9196-870d326ee640 req-fff07c63-7b7b-4dc0-b60e-b57f1a90dee6 service nova] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b6f4865c-aef1-4070-9196-870d326ee640 req-fff07c63-7b7b-4dc0-b60e-b57f1a90dee6 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-b6f4865c-aef1-4070-9196-870d326ee640 req-fff07c63-7b7b-4dc0-b60e-b57f1a90dee6 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG nova.compute.manager [req-b6f4865c-aef1-4070-9196-870d326ee640 req-fff07c63-7b7b-4dc0-b60e-b57f1a90dee6 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] No waiting events found dispatching network-vif-unplugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG nova.compute.manager [req-b6f4865c-aef1-4070-9196-870d326ee640 req-fff07c63-7b7b-4dc0-b60e-b57f1a90dee6 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-vif-unplugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Instance destroyed successfully.
Jul 28 01:06:26 user nova-compute[70709]: DEBUG nova.objects.instance [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lazy-loading 'resources' on Instance uuid 76a928e1-468b-42fa-b517-aef8e8875a1d {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T01:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1718227989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1718227989',id=50,image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXn2FXN3MfBu2RspTmKfGv/RyIazRNjCnMgvETWMYIdkW0VqqwC5tcd8+tWCf4q3t0ocbvVlNTlCsdfvmzoiM05nTTK16xJgWQ0qTX3xNGz4Rr9nlOaTVz/A/+HXSm1ew==',key_name='tempest-keypair-1807857457',keypairs=<?>,launch_index=0,launched_at=2023-07-28T01:04:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be36b20189ca4ac5880e2404b59f20dc',ramdisk_id='',reservation_id='r-ztr04rox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='51efbb04-1b4c-43c9-99e8-6467b05b27ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2054382732',owner_user_name='tempest-AttachVolumeShelveTestJSON-2054382732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T01:04:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef098a320ff4116b6ea7cb12d6aa41a',uuid=76a928e1-468b-42fa-b517-aef8e8875a1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converting VIF {"id": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "address": "fa:16:3e:e3:30:a4", "network": {"id": "b7784ea6-33c4-4e8c-861e-d13a85daa7bc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1083810127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be36b20189ca4ac5880e2404b59f20dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5f6a90-9c", "ovs_interfaceid": "1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG os_vif [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b5f6a90-9c, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:06:26 user nova-compute[70709]: INFO os_vif [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:30:a4,bridge_name='br-int',has_traffic_filtering=True,id=1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4,network=Network(b7784ea6-33c4-4e8c-861e-d13a85daa7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5f6a90-9c')
Jul 28 01:06:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Deleting instance files /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d_del
Jul 28 01:06:26 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Deletion of /opt/stack/data/nova/instances/76a928e1-468b-42fa-b517-aef8e8875a1d_del complete
Jul 28 01:06:26 user nova-compute[70709]: INFO nova.compute.manager [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 28 01:06:26 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 01:06:26 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 01:06:27 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:06:27 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Took 0.91 seconds to deallocate network for instance.
Jul 28 01:06:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-cbb900da-a9ca-4654-8cc1-053bbe0c623c req-ab900b5a-7898-4602-ba26-38630055d7ce service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-vif-deleted-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:06:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:06:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:06:27 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:06:27 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:06:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:06:27 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Deleted allocations for instance 76a928e1-468b-42fa-b517-aef8e8875a1d
Jul 28 01:06:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-65bf42b5-d4f4-4891-ae19-6710e2218de7 tempest-AttachVolumeShelveTestJSON-2054382732 tempest-AttachVolumeShelveTestJSON-2054382732-project-member] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.962s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:06:28 user nova-compute[70709]: DEBUG nova.compute.manager [req-465f7739-022c-4880-be3e-092ffd6b3180 req-bebab083-522c-483b-be80-87aff8881ff7 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:06:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-465f7739-022c-4880-be3e-092ffd6b3180 req-bebab083-522c-483b-be80-87aff8881ff7 service nova] Acquiring lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:06:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-465f7739-022c-4880-be3e-092ffd6b3180 req-bebab083-522c-483b-be80-87aff8881ff7 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:06:28 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-465f7739-022c-4880-be3e-092ffd6b3180 req-bebab083-522c-483b-be80-87aff8881ff7 service nova] Lock "76a928e1-468b-42fa-b517-aef8e8875a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:06:28 user nova-compute[70709]: DEBUG nova.compute.manager [req-465f7739-022c-4880-be3e-092ffd6b3180 req-bebab083-522c-483b-be80-87aff8881ff7 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] No waiting events found dispatching network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:06:28 user nova-compute[70709]: WARNING nova.compute.manager [req-465f7739-022c-4880-be3e-092ffd6b3180 req-bebab083-522c-483b-be80-87aff8881ff7 service nova] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Received unexpected event network-vif-plugged-1b5f6a90-9cbc-4b93-a94b-20e2ea5653f4 for instance with vm_state deleted and task_state None.
Jul 28 01:06:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:32 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 01:06:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 01:06:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:39 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:41 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690506386.395913, 76a928e1-468b-42fa-b517-aef8e8875a1d => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:06:41 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] VM Stopped (Lifecycle Event)
Jul 28 01:06:41 user nova-compute[70709]: DEBUG nova.compute.manager [None req-13c34c03-1628-45ce-8d12-799c03a0610a None None] [instance: 76a928e1-468b-42fa-b517-aef8e8875a1d] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:06:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:06:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:06:50 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:06:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:06:50 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:06:50 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:06:51 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:06:51 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:06:51 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=25.168560028076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:06:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:06:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:06:56 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:56 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:56 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:06:56 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:06:59 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:07:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:07:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:07:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:07:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:07:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:07:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:03 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:07:04 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:07:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:07:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:07:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:07:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:07:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:07:11 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 01:07:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:07:15 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:07:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:07:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:07:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:07:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:07:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:07:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:07:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:07:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:07:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:07:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:07:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:07:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:07:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:35 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:50 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:51 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:07:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:07:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:07:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:07:51 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:07:52 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:07:52 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:07:52 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=9017MB free_disk=25.158660888671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:07:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:07:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:07:52 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:07:52 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:07:52 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:07:52 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:07:52 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:07:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.102s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:07:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:56 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:07:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:57 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:07:57 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:07:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:07:58 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:07:59 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:08:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:08:04 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:08:05 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:08:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:08:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:08:13 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:08:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:08:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:08:13 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 01:08:13 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:08:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:08:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:08:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:08:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:08:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:08:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:08:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:08:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:08:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:08:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:08:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:08:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:08:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:08:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:08:51 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:08:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:08:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:08:51 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:08:51 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:08:52 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:08:52 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:08:52 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=25.156261444091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:08:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:08:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:08:52 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:08:52 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:08:52 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:08:52 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:08:52 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:08:52 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:08:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:08:58 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:08:58 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:08:58 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:08:58 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:09:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:09:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:09:04 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:09:05 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:09:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:15 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:15 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:09:15 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:09:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:09:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:09:15 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 01:09:15 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:09:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Starting instance... {{(pid=70709) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 01:09:27 user nova-compute[70709]: INFO nova.compute.claims [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Claim successful on node user
Jul 28 01:09:27 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Start building networks asynchronously for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Allocating IP information in the background. {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG nova.network.neutron [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] allocate_for_instance() {{(pid=70709) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 28 01:09:27 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 28 01:09:27 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Start building block device mappings for instance. {{(pid=70709) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 28 01:09:27 user nova-compute[70709]: INFO nova.virt.block_device [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Booting with volume 24d04029-aae9-430c-b13a-b00ca76be698 at /dev/vda
Jul 28 01:09:27 user nova-compute[70709]: DEBUG nova.policy [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a6244d73f8042d49b1d90b695a843e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17b1c29af647e7bd750c554a56522f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70709) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG os_brick.utils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 01:09:27 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0729c46-c59f-4ba3-8471-5e5852fd0f76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37d15ca-c0f7-40c9-b77a-18c3ed930933]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5547b64-d3be-4708-901c-97604b0b17f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2987a0-baaa-48cc-8285-360c85fe5ac2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 01:09:28 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 01:09:28 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5535145-4abd-48d6-9139-1948be9e3699]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG os_brick.utils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating existing volume attachment record: 94d7300d-b99a-4a6b-9f2b-bf271820cf6e {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG nova.network.neutron [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Successfully created port: b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 28 01:09:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG nova.network.neutron [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Successfully updated port: b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG nova.network.neutron [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG nova.network.neutron [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Instance cache missing network info. {{(pid=70709) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-2abe60cc-e1b5-408d-9ac7-8c3fbd2d7a60 req-95004b34-ebaf-48d3-aeb9-5465b4055edf service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-changed-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG nova.compute.manager [req-2abe60cc-e1b5-408d-9ac7-8c3fbd2d7a60 req-95004b34-ebaf-48d3-aeb9-5465b4055edf service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Refreshing instance network info cache due to event network-changed-b91f8afb-e2d6-45d8-822a-b4a087b21f67. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2abe60cc-e1b5-408d-9ac7-8c3fbd2d7a60 req-95004b34-ebaf-48d3-aeb9-5465b4055edf service nova] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG nova.network.neutron [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Instance network_info: |[{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70709) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2abe60cc-e1b5-408d-9ac7-8c3fbd2d7a60 req-95004b34-ebaf-48d3-aeb9-5465b4055edf service nova] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:09:29 user nova-compute[70709]: DEBUG nova.network.neutron [req-2abe60cc-e1b5-408d-9ac7-8c3fbd2d7a60 req-95004b34-ebaf-48d3-aeb9-5465b4055edf service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Refreshing network info cache for port b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 01:09:30 user nova-compute[70709]: DEBUG nova.network.neutron [req-2abe60cc-e1b5-408d-9ac7-8c3fbd2d7a60 req-95004b34-ebaf-48d3-aeb9-5465b4055edf service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updated VIF entry in instance network info cache for port b91f8afb-e2d6-45d8-822a-b4a087b21f67. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 01:09:30 user nova-compute[70709]: DEBUG nova.network.neutron [req-2abe60cc-e1b5-408d-9ac7-8c3fbd2d7a60 req-95004b34-ebaf-48d3-aeb9-5465b4055edf service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:09:30 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2abe60cc-e1b5-408d-9ac7-8c3fbd2d7a60 req-95004b34-ebaf-48d3-aeb9-5465b4055edf service nova] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:09:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Start spawning the instance on the hypervisor. {{(pid=70709) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 01:09:34 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Creating image(s)
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Ensure instance console log exists: /opt/stack/data/nova/instances/5d78016f-795e-4c17-8d68-8faaf5e7fcb5/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Start _get_guest_xml network_info=[{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '94d7300d-b99a-4a6b-9f2b-bf271820cf6e', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDXIKybw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5d78016f-795e-4c17-8d68-8faaf5e7fcb5', 'attached_at': '', 'detached_at': '', 'volume_id': '24d04029-aae9-430c-b13a-b00ca76be698', 'serial': '24d04029-aae9-430c-b13a-b00ca76be698'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 01:09:34 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:09:34 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDXIKybw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 01:09:34 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 01:09:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 01:09:34 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 01:09:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 01:09:34 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad31a799-e7a8-43ec-b86f-829edb83f57c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 01:09:34 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a43132-674a-455a-9f96-2aa26a0db522]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698] added
Jul 28 01:09:34 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcee86a-a37f-4803-88b8-d302a1685834]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c36dd9-403b-46cb-9836-80ce587cf003]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:09:34 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDXIKybw {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDXIKybw" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8f5009-b872-4b73-83c6-8f5973c2686d]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gDXIKybw'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[075c6afb-f9b2-4a31-acef-2c6d2200ba97]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6d39de-553f-47be-aa50-83d273ec17cc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 28 01:09:35 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 28 01:09:35 user nova-compute[70709]:  {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 01:09:35 user nova-compute[70709]: WARNING os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 28 01:09:35 user nova-compute[70709]: 
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f654df1-fea1-4909-b4fe-e48ca7c7b6d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260]
Jul 28 01:09:35 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260] successful.
Jul 28 01:09:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fffafbc-f633-41dc-abc2-903b7f02dbee]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e11e91-0016-49de-96c0-8f9e167b6389]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)
Jul 28 01:09:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)
Jul 28 01:09:35 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3f321f-c40f-4009-845c-3b3f7b9bebbd]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 01:09:35 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDXIKybw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23765663762636165', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765663762636165', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T01:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-611965703',display_name='tempest-TestShelveInstance-server-611965703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-611965703',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYPPdUh4+tCJRVjmA5aLzp4QsludlGT7POfFeAD65gUZmnMU1u5A4U8rXHKZfqGfvRv4kpQGXRvgMFwK3SU8BGMHuD5Tqe/xnoPtyMpxKkVuuVWP7vXItwXtVI72XXR8g==',key_name='tempest-TestShelveInstance-339528514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b17b1c29af647e7bd750c554a56522f',ramdisk_id='',reservation_id='r-lqfa0a1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1833749575',owner_user_name='tempest-TestShelveInstance-1833749575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T01:09:28Z,user_data=None,user_id='5a6244d73f8042d49b1d90b695a843e9',uuid=5d78016f-795e-4c17-8d68-8faaf5e7fcb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converting VIF {"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG nova.objects.instance [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] End _get_guest_xml xml=<domain type="kvm">
Jul 28 01:09:36 user nova-compute[70709]:   <uuid>5d78016f-795e-4c17-8d68-8faaf5e7fcb5</uuid>
Jul 28 01:09:36 user nova-compute[70709]:   <name>instance-00000033</name>
Jul 28 01:09:36 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 01:09:36 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 01:09:36 user nova-compute[70709]:   <metadata>
Jul 28 01:09:36 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 01:09:36 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 01:09:36 user nova-compute[70709]:       <nova:name>tempest-TestShelveInstance-server-611965703</nova:name>
Jul 28 01:09:36 user nova-compute[70709]:       <nova:creationTime>2023-07-28 01:09:34</nova:creationTime>
Jul 28 01:09:36 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 01:09:36 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 01:09:36 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 01:09:36 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 01:09:36 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 01:09:36 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 01:09:36 user nova-compute[70709]:       </nova:flavor>
Jul 28 01:09:36 user nova-compute[70709]:       <nova:owner>
Jul 28 01:09:36 user nova-compute[70709]:         <nova:user uuid="5a6244d73f8042d49b1d90b695a843e9">tempest-TestShelveInstance-1833749575-project-member</nova:user>
Jul 28 01:09:36 user nova-compute[70709]:         <nova:project uuid="9b17b1c29af647e7bd750c554a56522f">tempest-TestShelveInstance-1833749575</nova:project>
Jul 28 01:09:36 user nova-compute[70709]:       </nova:owner>
Jul 28 01:09:36 user nova-compute[70709]:       <nova:ports>
Jul 28 01:09:36 user nova-compute[70709]:         <nova:port uuid="b91f8afb-e2d6-45d8-822a-b4a087b21f67">
Jul 28 01:09:36 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 28 01:09:36 user nova-compute[70709]:         </nova:port>
Jul 28 01:09:36 user nova-compute[70709]:       </nova:ports>
Jul 28 01:09:36 user nova-compute[70709]:     </nova:instance>
Jul 28 01:09:36 user nova-compute[70709]:   </metadata>
Jul 28 01:09:36 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 01:09:36 user nova-compute[70709]:     <system>
Jul 28 01:09:36 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 01:09:36 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 01:09:36 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 01:09:36 user nova-compute[70709]:       <entry name="serial">5d78016f-795e-4c17-8d68-8faaf5e7fcb5</entry>
Jul 28 01:09:36 user nova-compute[70709]:       <entry name="uuid">5d78016f-795e-4c17-8d68-8faaf5e7fcb5</entry>
Jul 28 01:09:36 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 01:09:36 user nova-compute[70709]:     </system>
Jul 28 01:09:36 user nova-compute[70709]:   </sysinfo>
Jul 28 01:09:36 user nova-compute[70709]:   <os>
Jul 28 01:09:36 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 01:09:36 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 01:09:36 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 01:09:36 user nova-compute[70709]:   </os>
Jul 28 01:09:36 user nova-compute[70709]:   <features>
Jul 28 01:09:36 user nova-compute[70709]:     <acpi/>
Jul 28 01:09:36 user nova-compute[70709]:     <apic/>
Jul 28 01:09:36 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 01:09:36 user nova-compute[70709]:   </features>
Jul 28 01:09:36 user nova-compute[70709]:   <clock offset="utc">
Jul 28 01:09:36 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 01:09:36 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 01:09:36 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 01:09:36 user nova-compute[70709]:   </clock>
Jul 28 01:09:36 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 01:09:36 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 01:09:36 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 01:09:36 user nova-compute[70709]:   </cpu>
Jul 28 01:09:36 user nova-compute[70709]:   <devices>
Jul 28 01:09:36 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 01:09:36 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 01:09:36 user nova-compute[70709]:       <source dev="/dev/sdb"/>
Jul 28 01:09:36 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 01:09:36 user nova-compute[70709]:       <serial>24d04029-aae9-430c-b13a-b00ca76be698</serial>
Jul 28 01:09:36 user nova-compute[70709]:     </disk>
Jul 28 01:09:36 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 01:09:36 user nova-compute[70709]:       <mac address="fa:16:3e:35:ce:ea"/>
Jul 28 01:09:36 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 01:09:36 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 01:09:36 user nova-compute[70709]:       <target dev="tapb91f8afb-e2"/>
Jul 28 01:09:36 user nova-compute[70709]:     </interface>
Jul 28 01:09:36 user nova-compute[70709]:     <serial type="pty">
Jul 28 01:09:36 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/5d78016f-795e-4c17-8d68-8faaf5e7fcb5/console.log" append="off"/>
Jul 28 01:09:36 user nova-compute[70709]:     </serial>
Jul 28 01:09:36 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 01:09:36 user nova-compute[70709]:     <video>
Jul 28 01:09:36 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 01:09:36 user nova-compute[70709]:     </video>
Jul 28 01:09:36 user nova-compute[70709]:     <rng model="virtio">
Jul 28 01:09:36 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 01:09:36 user nova-compute[70709]:     </rng>
Jul 28 01:09:36 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 01:09:36 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 01:09:36 user nova-compute[70709]:       <stats period="10"/>
Jul 28 01:09:36 user nova-compute[70709]:     </memballoon>
Jul 28 01:09:36 user nova-compute[70709]:   </devices>
Jul 28 01:09:36 user nova-compute[70709]: </domain>
Jul 28 01:09:36 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T01:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-611965703',display_name='tempest-TestShelveInstance-server-611965703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-611965703',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYPPdUh4+tCJRVjmA5aLzp4QsludlGT7POfFeAD65gUZmnMU1u5A4U8rXHKZfqGfvRv4kpQGXRvgMFwK3SU8BGMHuD5Tqe/xnoPtyMpxKkVuuVWP7vXItwXtVI72XXR8g==',key_name='tempest-TestShelveInstance-339528514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b17b1c29af647e7bd750c554a56522f',ramdisk_id='',reservation_id='r-lqfa0a1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1833749575',owner_user_name='tempest-TestShelveInstance-1833749575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-28T01:09:28Z,user_data=None,user_id='5a6244d73f8042d49b1d90b695a843e9',uuid=5d78016f-795e-4c17-8d68-8faaf5e7fcb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converting VIF {"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG os_vif [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb91f8afb-e2, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb91f8afb-e2, col_values=(('external_ids', {'iface-id': 'b91f8afb-e2d6-45d8-822a-b4a087b21f67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:ce:ea', 'vm-uuid': '5d78016f-795e-4c17-8d68-8faaf5e7fcb5'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:36 user nova-compute[70709]: INFO os_vif [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2')
Jul 28 01:09:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 01:09:36 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] No VIF found with MAC fa:16:3e:35:ce:ea, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 01:09:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:37 user nova-compute[70709]: DEBUG nova.compute.manager [req-3ead9337-2586-4ab4-a67d-2c9631aec93d req-ec01580f-2f3c-4377-950f-559e77cc7e4e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:09:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3ead9337-2586-4ab4-a67d-2c9631aec93d req-ec01580f-2f3c-4377-950f-559e77cc7e4e service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:09:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3ead9337-2586-4ab4-a67d-2c9631aec93d req-ec01580f-2f3c-4377-950f-559e77cc7e4e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:09:37 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-3ead9337-2586-4ab4-a67d-2c9631aec93d req-ec01580f-2f3c-4377-950f-559e77cc7e4e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:09:37 user nova-compute[70709]: DEBUG nova.compute.manager [req-3ead9337-2586-4ab4-a67d-2c9631aec93d req-ec01580f-2f3c-4377-950f-559e77cc7e4e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:09:37 user nova-compute[70709]: WARNING nova.compute.manager [req-3ead9337-2586-4ab4-a67d-2c9631aec93d req-ec01580f-2f3c-4377-950f-559e77cc7e4e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received unexpected event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with vm_state building and task_state spawning.
Jul 28 01:09:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690506579.806935, 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:09:39 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] VM Resumed (Lifecycle Event)
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 01:09:39 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Instance spawned successfully.
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Found default for hw_cdrom_bus of ide {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Found default for hw_disk_bus of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Found default for hw_input_bus of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Found default for hw_pointer_model of None {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Found default for hw_video_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Found default for hw_vif_model of virtio {{(pid=70709) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 28 01:09:39 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690506579.8086805, 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:09:39 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] VM Started (Lifecycle Event)
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 01:09:39 user nova-compute[70709]: INFO nova.compute.manager [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Took 5.09 seconds to spawn the instance on the hypervisor.
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.compute.manager [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:09:39 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.compute.manager [req-6300a405-68ca-4a95-a4a8-833634e7c8b2 req-16161933-540b-42d5-b369-379395f0c714 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6300a405-68ca-4a95-a4a8-833634e7c8b2 req-16161933-540b-42d5-b369-379395f0c714 service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6300a405-68ca-4a95-a4a8-833634e7c8b2 req-16161933-540b-42d5-b369-379395f0c714 service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-6300a405-68ca-4a95-a4a8-833634e7c8b2 req-16161933-540b-42d5-b369-379395f0c714 service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:09:39 user nova-compute[70709]: DEBUG nova.compute.manager [req-6300a405-68ca-4a95-a4a8-833634e7c8b2 req-16161933-540b-42d5-b369-379395f0c714 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:09:39 user nova-compute[70709]: WARNING nova.compute.manager [req-6300a405-68ca-4a95-a4a8-833634e7c8b2 req-16161933-540b-42d5-b369-379395f0c714 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received unexpected event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with vm_state building and task_state spawning.
Jul 28 01:09:40 user nova-compute[70709]: INFO nova.compute.manager [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Took 12.67 seconds to build instance.
Jul 28 01:09:40 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-f08eecdd-890f-4afc-bc3e-3a0513494464 tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.788s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:09:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:53 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:09:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:09:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:09:53 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:09:53 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:09:53 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 01:09:54 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:09:54 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:09:54 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=25.15314483642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:09:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:09:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:09:54 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 01:09:54 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:09:54 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:09:54 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:09:54 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:09:54 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:09:54 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:09:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:09:59 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:09:59 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:09:59 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:09:59 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:10:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:03 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:10:04 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:10:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:10:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:10:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:15 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:10:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:10:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:10:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:10:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:10:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:10:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:10:17 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:10:17 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 01:10:17 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:10:18 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:10:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:10:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 01:10:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:10:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:10:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:10:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:10:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:26 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:10:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:10:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:31 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:10:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:10:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:36 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:10:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:10:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:41 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:10:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:10:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:46 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:10:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:10:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:10:51 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:55 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:10:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:10:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:10:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:10:55 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:10:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 01:10:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:10:56 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:10:56 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:10:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8865MB free_disk=25.15247344970703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:10:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:10:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:10:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 01:10:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:10:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:10:56 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:10:56 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:10:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:10:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:11:01 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Triggering sync for uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 28 01:11:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:11:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:11:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:01 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:11:01 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:11:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:01 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:04 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:05 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:06 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:11:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:11:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:11:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:11:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:11:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:11:11 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:11:15 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:11:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:11:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:11:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:11:16 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:11:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:11:17 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:11:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:11:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:11:18 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 01:11:18 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:11:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:18 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:11:18 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:11:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 01:11:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:18 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 28 01:11:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-4ce3d04b-b02b-4eed-9507-08d1be5afce3 req-105dc583-54da-40a4-91b0-b6dde5f784bc service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-changed-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:11:19 user nova-compute[70709]: DEBUG nova.compute.manager [req-4ce3d04b-b02b-4eed-9507-08d1be5afce3 req-105dc583-54da-40a4-91b0-b6dde5f784bc service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Refreshing instance network info cache due to event network-changed-b91f8afb-e2d6-45d8-822a-b4a087b21f67. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 01:11:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4ce3d04b-b02b-4eed-9507-08d1be5afce3 req-105dc583-54da-40a4-91b0-b6dde5f784bc service nova] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:11:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4ce3d04b-b02b-4eed-9507-08d1be5afce3 req-105dc583-54da-40a4-91b0-b6dde5f784bc service nova] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:11:19 user nova-compute[70709]: DEBUG nova.network.neutron [req-4ce3d04b-b02b-4eed-9507-08d1be5afce3 req-105dc583-54da-40a4-91b0-b6dde5f784bc service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Refreshing network info cache for port b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 01:11:19 user nova-compute[70709]: DEBUG nova.network.neutron [req-4ce3d04b-b02b-4eed-9507-08d1be5afce3 req-105dc583-54da-40a4-91b0-b6dde5f784bc service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updated VIF entry in instance network info cache for port b91f8afb-e2d6-45d8-822a-b4a087b21f67. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 01:11:19 user nova-compute[70709]: DEBUG nova.network.neutron [req-4ce3d04b-b02b-4eed-9507-08d1be5afce3 req-105dc583-54da-40a4-91b0-b6dde5f784bc service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:11:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-4ce3d04b-b02b-4eed-9507-08d1be5afce3 req-105dc583-54da-40a4-91b0-b6dde5f784bc service nova] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:11:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:11:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:11:20 user nova-compute[70709]: INFO nova.compute.manager [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Shelve offloading
Jul 28 01:11:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-08ce471b-7d0f-401b-8136-185b2ffa8ee5 req-ba6cdb18-d7b4-41ec-8e5e-c95ba777ead6 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-unplugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:11:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-08ce471b-7d0f-401b-8136-185b2ffa8ee5 req-ba6cdb18-d7b4-41ec-8e5e-c95ba777ead6 service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:11:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-08ce471b-7d0f-401b-8136-185b2ffa8ee5 req-ba6cdb18-d7b4-41ec-8e5e-c95ba777ead6 service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:11:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-08ce471b-7d0f-401b-8136-185b2ffa8ee5 req-ba6cdb18-d7b4-41ec-8e5e-c95ba777ead6 service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:11:21 user nova-compute[70709]: DEBUG nova.compute.manager [req-08ce471b-7d0f-401b-8136-185b2ffa8ee5 req-ba6cdb18-d7b4-41ec-8e5e-c95ba777ead6 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-unplugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:11:21 user nova-compute[70709]: WARNING nova.compute.manager [req-08ce471b-7d0f-401b-8136-185b2ffa8ee5 req-ba6cdb18-d7b4-41ec-8e5e-c95ba777ead6 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received unexpected event network-vif-unplugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with vm_state active and task_state shelving.
Jul 28 01:11:21 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:21 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Instance destroyed successfully.
Jul 28 01:11:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:11:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:11:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:11:21 user nova-compute[70709]: DEBUG nova.network.neutron [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 01:11:22 user nova-compute[70709]: DEBUG nova.network.neutron [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:11:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:11:23 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Instance destroyed successfully.
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.objects.instance [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lazy-loading 'resources' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-28T01:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-611965703',display_name='tempest-TestShelveInstance-server-611965703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-611965703',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYPPdUh4+tCJRVjmA5aLzp4QsludlGT7POfFeAD65gUZmnMU1u5A4U8rXHKZfqGfvRv4kpQGXRvgMFwK3SU8BGMHuD5Tqe/xnoPtyMpxKkVuuVWP7vXItwXtVI72XXR8g==',key_name='tempest-TestShelveInstance-339528514',keypairs=<?>,launch_index=0,launched_at=2023-07-28T01:09:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b17b1c29af647e7bd750c554a56522f',ramdisk_id='',reservation_id='r-lqfa0a1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1833749575',owner_user_name='tempest-TestShelveInstance-1833749575-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T01:09:40Z,user_data=None,user_id='5a6244d73f8042d49b1d90b695a843e9',uuid=5d78016f-795e-4c17-8d68-8faaf5e7fcb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converting VIF {"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_vif [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb91f8afb-e2, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:11:23 user nova-compute[70709]: INFO os_vif [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2')
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDXIKybw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 01:11:23 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-2fcb495b-1403-4651-b83a-cfa36effb1a7 req-8f657f56-2b72-4cf4-9c9f-b886de15869a service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-changed-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-2fcb495b-1403-4651-b83a-cfa36effb1a7 req-8f657f56-2b72-4cf4-9c9f-b886de15869a service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Refreshing instance network info cache due to event network-changed-b91f8afb-e2d6-45d8-822a-b4a087b21f67. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2fcb495b-1403-4651-b83a-cfa36effb1a7 req-8f657f56-2b72-4cf4-9c9f-b886de15869a service nova] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2fcb495b-1403-4651-b83a-cfa36effb1a7 req-8f657f56-2b72-4cf4-9c9f-b886de15869a service nova] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.network.neutron [req-2fcb495b-1403-4651-b83a-cfa36effb1a7 req-8f657f56-2b72-4cf4-9c9f-b886de15869a service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Refreshing network info cache for port b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-f0c4c385-7669-4115-8e80-c0aedb829289 req-5dfa0323-ece5-4251-83ba-257f9d2a4a17 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f0c4c385-7669-4115-8e80-c0aedb829289 req-5dfa0323-ece5-4251-83ba-257f9d2a4a17 service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f0c4c385-7669-4115-8e80-c0aedb829289 req-5dfa0323-ece5-4251-83ba-257f9d2a4a17 service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-f0c4c385-7669-4115-8e80-c0aedb829289 req-5dfa0323-ece5-4251-83ba-257f9d2a4a17 service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.compute.manager [req-f0c4c385-7669-4115-8e80-c0aedb829289 req-5dfa0323-ece5-4251-83ba-257f9d2a4a17 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:11:23 user nova-compute[70709]: WARNING nova.compute.manager [req-f0c4c385-7669-4115-8e80-c0aedb829289 req-5dfa0323-ece5-4251-83ba-257f9d2a4a17 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received unexpected event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with vm_state active and task_state shelving.
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0db4574-668d-40ca-a2a1-e3fb13f2c0dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 01:11:23 user nova-compute[70709]: No targets found.
Jul 28 01:11:23 user nova-compute[70709]: iSNS:
Jul 28 01:11:23 user nova-compute[70709]: No targets found.
Jul 28 01:11:23 user nova-compute[70709]: STATIC:
Jul 28 01:11:23 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698
Jul 28 01:11:23 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 01:11:23 user nova-compute[70709]:                 Iface Name: default
Jul 28 01:11:23 user nova-compute[70709]: FIRMWARE:
Jul 28 01:11:23 user nova-compute[70709]: No targets found.
Jul 28 01:11:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 01:11:23 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 01:11:23 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3140b157-9dc5-4726-bcb7-d02caefebc48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5b32f0-d9dc-438b-90d3-0cfe27b2f073]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)
Jul 28 01:11:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)
Jul 28 01:11:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b905dfa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698'): ({'sdb'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Removing single pathed devices sdb {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b004bb-f0a4-426b-aef2-20c8783cc530]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa630c6-081e-41f9-ab23-2d3b2b8896d7]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Flushing IO for device /dev/sdb {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[2740b774-1bbb-4270-bcf8-8a33b76388c5]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1436cfe-13a0-475c-ab5f-1a10e01ed4c3]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61915b5-9667-4dda-be76-28e38236a4d0]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f24413-95c6-4ba0-a188-1957c19c7057]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260]
Jul 28 01:11:23 user nova-compute[70709]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260] successful.
Jul 28 01:11:23 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d0625-8ab7-4a43-b22e-7d79d955e598]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] <== disconnect_volume: return (279ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 01:11:23 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Deleting instance files /opt/stack/data/nova/instances/5d78016f-795e-4c17-8d68-8faaf5e7fcb5_del
Jul 28 01:11:23 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Deletion of /opt/stack/data/nova/instances/5d78016f-795e-4c17-8d68-8faaf5e7fcb5_del complete
Jul 28 01:11:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.network.neutron [req-2fcb495b-1403-4651-b83a-cfa36effb1a7 req-8f657f56-2b72-4cf4-9c9f-b886de15869a service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updated VIF entry in instance network info cache for port b91f8afb-e2d6-45d8-822a-b4a087b21f67. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG nova.network.neutron [req-2fcb495b-1403-4651-b83a-cfa36effb1a7 req-8f657f56-2b72-4cf4-9c9f-b886de15869a service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": null, "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:11:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-2fcb495b-1403-4651-b83a-cfa36effb1a7 req-8f657f56-2b72-4cf4-9c9f-b886de15869a service nova] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:11:24 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Deleted allocations for instance 5d78016f-795e-4c17-8d68-8faaf5e7fcb5
Jul 28 01:11:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:11:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:11:24 user nova-compute[70709]: DEBUG nova.objects.instance [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lazy-loading 'numa_topology' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:11:24 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:11:24 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:11:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.102s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:11:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6d8d9113-5ada-4c36-8058-dbeca1a5e50c tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.956s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:11:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:32 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 28 01:11:32 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] There are 0 instances to clean {{(pid=70709) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 28 01:11:33 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:36 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690506681.5696087, 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:11:36 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] VM Stopped (Lifecycle Event)
Jul 28 01:11:36 user nova-compute[70709]: DEBUG nova.compute.manager [None req-1938fc29-cbd6-40b8-a435-8d3d3af99596 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:11:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:11:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:11:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:11:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:11:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:11:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:11:48 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:11:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:11:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:11:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:11:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:11:55 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:11:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:11:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:11:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:11:55 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:11:56 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:11:56 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:11:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=25.151615142822266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing inventories for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating ProviderTree inventory for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Updating inventory in ProviderTree for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing aggregate associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, aggregates: None {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Refreshing trait associations for resource provider 4612f42c-a702-4177-9388-c9bc6a4c0da1, traits: HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=70709) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:11:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:11:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:02 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:12:02 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:12:02 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:12:02 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:12:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:12:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:04 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:12:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:12:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:12:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:12:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:15 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:12:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:12:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:19 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:12:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:12:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:12:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 01:12:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:12:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:12:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:33 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:12:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:38 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:12:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:12:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:12:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:12:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:12:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:12:55 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:12:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:12:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:12:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:12:55 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:12:56 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:12:56 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:12:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.14324188232422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:12:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:12:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:12:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:12:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:12:56 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:12:56 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:12:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:12:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:12:58 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:02 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:13:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:03 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:13:03 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:13:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:13:04 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:13:08 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:13:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:13:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:13:12 user nova-compute[70709]: INFO nova.compute.manager [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Unshelving
Jul 28 01:13:12 user nova-compute[70709]: INFO nova.virt.block_device [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Booting with volume 24d04029-aae9-430c-b13a-b00ca76be698 at /dev/vda
Jul 28 01:13:12 user nova-compute[70709]: DEBUG os_brick.utils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbc4473-e33a-4562-88bf-e31a73e4d37f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca3f3041384a\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4458a2-7279-400e-9e64-6a4d8569823f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2978253-1a58-42ea-acf6-c05084c4c1ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45e1a0f-9bb6-48d8-a4d2-dae267f1f3c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Running cmd (subprocess): nvme version {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] 'nvme version' failed. Not Retrying. {{(pid=70709) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] nvme not present on system {{(pid=70709) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 28 01:13:12 user nova-compute[70709]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 28 01:13:12 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[416d75f6-d396-4a91-af46-ea27e28eb901]: (4, '') {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70709) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.lightos [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] LIGHTOS: no hostnqn found. {{(pid=70709) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG os_brick.utils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca3f3041384a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 01:13:12 user nova-compute[70709]: DEBUG nova.virt.block_device [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating existing volume attachment record: b40549bf-6c2c-4a99-b66d-3267969e03a5 {{(pid=70709) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 28 01:13:13 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:13:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:13:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:13:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:13:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:13:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:13:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:13:18 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:13:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:13:19 user nova-compute[70709]: DEBUG nova.objects.instance [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lazy-loading 'pci_requests' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:13:19 user nova-compute[70709]: DEBUG nova.objects.instance [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lazy-loading 'numa_topology' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:13:19 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70709) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 28 01:13:19 user nova-compute[70709]: INFO nova.compute.claims [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Claim successful on node user
Jul 28 01:13:19 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:13:19 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:13:19 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:13:19 user nova-compute[70709]: INFO nova.network.neutron [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating port b91f8afb-e2d6-45d8-822a-b4a087b21f67 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 28 01:13:20 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:13:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:13:20 user nova-compute[70709]: DEBUG nova.network.neutron [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Building network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 28 01:13:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-7047dd87-6bc4-4803-960d-b6780fb941ee req-fd216c22-22bd-450e-a324-8f0189bd2408 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-changed-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:13:20 user nova-compute[70709]: DEBUG nova.compute.manager [req-7047dd87-6bc4-4803-960d-b6780fb941ee req-fd216c22-22bd-450e-a324-8f0189bd2408 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Refreshing instance network info cache due to event network-changed-b91f8afb-e2d6-45d8-822a-b4a087b21f67. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 01:13:20 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7047dd87-6bc4-4803-960d-b6780fb941ee req-fd216c22-22bd-450e-a324-8f0189bd2408 service nova] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.network.neutron [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Creating instance directory {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 28 01:13:21 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Creating image(s)
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Did not create local disks {{(pid=70709) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Ensure instance console log exists: /opt/stack/data/nova/instances/5d78016f-795e-4c17-8d68-8faaf5e7fcb5/console.log {{(pid=70709) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Start _get_guest_xml network_info=[{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b40549bf-6c2c-4a99-b66d-3267969e03a5', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDXIKybw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5d78016f-795e-4c17-8d68-8faaf5e7fcb5', 'attached_at': '', 'detached_at': '', 'volume_id': '24d04029-aae9-430c-b13a-b00ca76be698', 'serial': '24d04029-aae9-430c-b13a-b00ca76be698'}, 'guest_format': None, 'volume_type': None} {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7047dd87-6bc4-4803-960d-b6780fb941ee req-fd216c22-22bd-450e-a324-8f0189bd2408 service nova] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.network.neutron [req-7047dd87-6bc4-4803-960d-b6780fb941ee req-fd216c22-22bd-450e-a324-8f0189bd2408 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Refreshing network info cache for port b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 01:13:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:13:21 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] CPU controller missing on host. {{(pid=70709) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.host [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] CPU controller found on host. {{(pid=70709) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70709) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-28T00:10:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Flavor limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Image limits 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Flavor pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Image pref 0:0:0 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Got 1 possible topologies {{(pid=70709) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.hardware [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70709) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.objects.instance [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Calling os-brick to attach iSCSI Volume {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDXIKybw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 01:13:21 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 01:13:21 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 01:13:21 user nova-compute[70709]: INFO os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c8f9d0-895e-4204-97d6-a1987175f86c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 28 01:13:21 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --interface default --op new {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7669119f-bee3-4559-980c-ca2ef433c90a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698] added\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698] added
Jul 28 01:13:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dd9b7e-c45a-4a81-88b9-fcaf682f0882]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7ad582-378f-4c70-8af8-c46af86dddd9]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDXIKybw {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDXIKybw" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5decc2c4-c183-4179-a186-a70160cc0dcc]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gDXIKybw'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdd463a-d7e9-4d7a-9ba5-1d113889fca6]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3d64f3-710d-4213-b380-e2f30f2d15f5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 28 01:13:21 user nova-compute[70709]:  {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 28 01:13:21 user nova-compute[70709]:  {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 01:13:21 user nova-compute[70709]: WARNING os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 28 01:13:21 user nova-compute[70709]: 
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --login {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0a2211-c42b-4337-9618-f1f0056c5fa2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260]
Jul 28 01:13:21 user nova-compute[70709]: Login to [iface: default, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260] successful.
Jul 28 01:13:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[08faf70a-b4de-416f-a57d-6ec1ba499e99]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e9d361-8576-4c57-a76f-77d377dadbf2]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)
Jul 28 01:13:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)
Jul 28 01:13:21 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Connected to 172.16.0.220:3260 {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=70709) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70709) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[3483d3bb-119c-4a57-8c8b-f064701c563c]: (4, ('- - 0', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.network.neutron [req-7047dd87-6bc4-4803-960d-b6780fb941ee req-fd216c22-22bd-450e-a324-8f0189bd2408 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updated VIF entry in instance network info cache for port b91f8afb-e2d6-45d8-822a-b4a087b21f67. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.network.neutron [req-7047dd87-6bc4-4803-960d-b6780fb941ee req-fd216c22-22bd-450e-a324-8f0189bd2408 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-7047dd87-6bc4-4803-960d-b6780fb941ee req-fd216c22-22bd-450e-a324-8f0189bd2408 service nova] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 01:13:21 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70709) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDXIKybw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70709) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23765663762636165', 'path': '/dev/sdb'} {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765663762636165', 'path': '/dev/sdb'} {{(pid=70709) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T01:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-611965703',display_name='tempest-TestShelveInstance-server-611965703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-611965703',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-339528514',keypairs=<?>,launch_index=0,launched_at=2023-07-28T01:09:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9b17b1c29af647e7bd750c554a56522f',ramdisk_id='',reservation_id='r-lqfa0a1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1833749575',owner_user_name='tempest-TestShelveInstance-1833749575-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T01:13:13Z,user_data=None,user_id='5a6244d73f8042d49b1d90b695a843e9',uuid=5d78016f-795e-4c17-8d68-8faaf5e7fcb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70709) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converting VIF {"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.objects.instance [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] End _get_guest_xml xml=<domain type="kvm">
Jul 28 01:13:22 user nova-compute[70709]:   <uuid>5d78016f-795e-4c17-8d68-8faaf5e7fcb5</uuid>
Jul 28 01:13:22 user nova-compute[70709]:   <name>instance-00000033</name>
Jul 28 01:13:22 user nova-compute[70709]:   <memory>524288</memory>
Jul 28 01:13:22 user nova-compute[70709]:   <vcpu>1</vcpu>
Jul 28 01:13:22 user nova-compute[70709]:   <metadata>
Jul 28 01:13:22 user nova-compute[70709]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 28 01:13:22 user nova-compute[70709]:       <nova:package version="0.0.0"/>
Jul 28 01:13:22 user nova-compute[70709]:       <nova:name>tempest-TestShelveInstance-server-611965703</nova:name>
Jul 28 01:13:22 user nova-compute[70709]:       <nova:creationTime>2023-07-28 01:13:21</nova:creationTime>
Jul 28 01:13:22 user nova-compute[70709]:       <nova:flavor name="m1.tiny">
Jul 28 01:13:22 user nova-compute[70709]:         <nova:memory>512</nova:memory>
Jul 28 01:13:22 user nova-compute[70709]:         <nova:disk>1</nova:disk>
Jul 28 01:13:22 user nova-compute[70709]:         <nova:swap>0</nova:swap>
Jul 28 01:13:22 user nova-compute[70709]:         <nova:ephemeral>0</nova:ephemeral>
Jul 28 01:13:22 user nova-compute[70709]:         <nova:vcpus>1</nova:vcpus>
Jul 28 01:13:22 user nova-compute[70709]:       </nova:flavor>
Jul 28 01:13:22 user nova-compute[70709]:       <nova:owner>
Jul 28 01:13:22 user nova-compute[70709]:         <nova:user uuid="5a6244d73f8042d49b1d90b695a843e9">tempest-TestShelveInstance-1833749575-project-member</nova:user>
Jul 28 01:13:22 user nova-compute[70709]:         <nova:project uuid="9b17b1c29af647e7bd750c554a56522f">tempest-TestShelveInstance-1833749575</nova:project>
Jul 28 01:13:22 user nova-compute[70709]:       </nova:owner>
Jul 28 01:13:22 user nova-compute[70709]:       <nova:ports>
Jul 28 01:13:22 user nova-compute[70709]:         <nova:port uuid="b91f8afb-e2d6-45d8-822a-b4a087b21f67">
Jul 28 01:13:22 user nova-compute[70709]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 28 01:13:22 user nova-compute[70709]:         </nova:port>
Jul 28 01:13:22 user nova-compute[70709]:       </nova:ports>
Jul 28 01:13:22 user nova-compute[70709]:     </nova:instance>
Jul 28 01:13:22 user nova-compute[70709]:   </metadata>
Jul 28 01:13:22 user nova-compute[70709]:   <sysinfo type="smbios">
Jul 28 01:13:22 user nova-compute[70709]:     <system>
Jul 28 01:13:22 user nova-compute[70709]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 28 01:13:22 user nova-compute[70709]:       <entry name="product">OpenStack Nova</entry>
Jul 28 01:13:22 user nova-compute[70709]:       <entry name="version">0.0.0</entry>
Jul 28 01:13:22 user nova-compute[70709]:       <entry name="serial">5d78016f-795e-4c17-8d68-8faaf5e7fcb5</entry>
Jul 28 01:13:22 user nova-compute[70709]:       <entry name="uuid">5d78016f-795e-4c17-8d68-8faaf5e7fcb5</entry>
Jul 28 01:13:22 user nova-compute[70709]:       <entry name="family">Virtual Machine</entry>
Jul 28 01:13:22 user nova-compute[70709]:     </system>
Jul 28 01:13:22 user nova-compute[70709]:   </sysinfo>
Jul 28 01:13:22 user nova-compute[70709]:   <os>
Jul 28 01:13:22 user nova-compute[70709]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 28 01:13:22 user nova-compute[70709]:     <boot dev="hd"/>
Jul 28 01:13:22 user nova-compute[70709]:     <smbios mode="sysinfo"/>
Jul 28 01:13:22 user nova-compute[70709]:   </os>
Jul 28 01:13:22 user nova-compute[70709]:   <features>
Jul 28 01:13:22 user nova-compute[70709]:     <acpi/>
Jul 28 01:13:22 user nova-compute[70709]:     <apic/>
Jul 28 01:13:22 user nova-compute[70709]:     <vmcoreinfo/>
Jul 28 01:13:22 user nova-compute[70709]:   </features>
Jul 28 01:13:22 user nova-compute[70709]:   <clock offset="utc">
Jul 28 01:13:22 user nova-compute[70709]:     <timer name="pit" tickpolicy="delay"/>
Jul 28 01:13:22 user nova-compute[70709]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 28 01:13:22 user nova-compute[70709]:     <timer name="hpet" present="no"/>
Jul 28 01:13:22 user nova-compute[70709]:   </clock>
Jul 28 01:13:22 user nova-compute[70709]:   <cpu mode="custom" match="exact">
Jul 28 01:13:22 user nova-compute[70709]:     <model>Nehalem</model>
Jul 28 01:13:22 user nova-compute[70709]:     <topology sockets="1" cores="1" threads="1"/>
Jul 28 01:13:22 user nova-compute[70709]:   </cpu>
Jul 28 01:13:22 user nova-compute[70709]:   <devices>
Jul 28 01:13:22 user nova-compute[70709]:     <disk type="block" device="disk">
Jul 28 01:13:22 user nova-compute[70709]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 28 01:13:22 user nova-compute[70709]:       <source dev="/dev/sdb"/>
Jul 28 01:13:22 user nova-compute[70709]:       <target dev="vda" bus="virtio"/>
Jul 28 01:13:22 user nova-compute[70709]:       <serial>24d04029-aae9-430c-b13a-b00ca76be698</serial>
Jul 28 01:13:22 user nova-compute[70709]:     </disk>
Jul 28 01:13:22 user nova-compute[70709]:     <interface type="ethernet">
Jul 28 01:13:22 user nova-compute[70709]:       <mac address="fa:16:3e:35:ce:ea"/>
Jul 28 01:13:22 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 01:13:22 user nova-compute[70709]:       <mtu size="1442"/>
Jul 28 01:13:22 user nova-compute[70709]:       <target dev="tapb91f8afb-e2"/>
Jul 28 01:13:22 user nova-compute[70709]:     </interface>
Jul 28 01:13:22 user nova-compute[70709]:     <serial type="pty">
Jul 28 01:13:22 user nova-compute[70709]:       <log file="/opt/stack/data/nova/instances/5d78016f-795e-4c17-8d68-8faaf5e7fcb5/console.log" append="off"/>
Jul 28 01:13:22 user nova-compute[70709]:     </serial>
Jul 28 01:13:22 user nova-compute[70709]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 28 01:13:22 user nova-compute[70709]:     <video>
Jul 28 01:13:22 user nova-compute[70709]:       <model type="virtio"/>
Jul 28 01:13:22 user nova-compute[70709]:     </video>
Jul 28 01:13:22 user nova-compute[70709]:     <rng model="virtio">
Jul 28 01:13:22 user nova-compute[70709]:       <backend model="random">/dev/urandom</backend>
Jul 28 01:13:22 user nova-compute[70709]:     </rng>
Jul 28 01:13:22 user nova-compute[70709]:     <controller type="usb" index="0" model="none"/>
Jul 28 01:13:22 user nova-compute[70709]:     <memballoon model="virtio">
Jul 28 01:13:22 user nova-compute[70709]:       <stats period="10"/>
Jul 28 01:13:22 user nova-compute[70709]:     </memballoon>
Jul 28 01:13:22 user nova-compute[70709]:   </devices>
Jul 28 01:13:22 user nova-compute[70709]: </domain>
Jul 28 01:13:22 user nova-compute[70709]:  {{(pid=70709) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T01:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-611965703',display_name='tempest-TestShelveInstance-server-611965703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-611965703',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-339528514',keypairs=<?>,launch_index=0,launched_at=2023-07-28T01:09:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9b17b1c29af647e7bd750c554a56522f',ramdisk_id='',reservation_id='r-lqfa0a1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1833749575',owner_user_name='tempest-TestShelveInstance-1833749575-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T01:13:13Z,user_data=None,user_id='5a6244d73f8042d49b1d90b695a843e9',uuid=5d78016f-795e-4c17-8d68-8faaf5e7fcb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converting VIF {"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG os_vif [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2') {{(pid=70709) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb91f8afb-e2, may_exist=True, interface_attrs={}) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb91f8afb-e2, col_values=(('external_ids', {'iface-id': 'b91f8afb-e2d6-45d8-822a-b4a087b21f67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:ce:ea', 'vm-uuid': '5d78016f-795e-4c17-8d68-8faaf5e7fcb5'}),), if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:22 user nova-compute[70709]: INFO os_vif [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2')
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] No BDM found with device name vda, not building metadata. {{(pid=70709) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 28 01:13:22 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] No VIF found with MAC fa:16:3e:35:ce:ea, not building metadata {{(pid=70709) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 28 01:13:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:23 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:24 user nova-compute[70709]: DEBUG nova.compute.manager [req-5d6f97c1-90b8-4cc1-858b-add901e53418 req-f56ea3e5-13dc-48b7-9706-cf7306fc44b5 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:13:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5d6f97c1-90b8-4cc1-858b-add901e53418 req-f56ea3e5-13dc-48b7-9706-cf7306fc44b5 service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:13:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5d6f97c1-90b8-4cc1-858b-add901e53418 req-f56ea3e5-13dc-48b7-9706-cf7306fc44b5 service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:13:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-5d6f97c1-90b8-4cc1-858b-add901e53418 req-f56ea3e5-13dc-48b7-9706-cf7306fc44b5 service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:13:24 user nova-compute[70709]: DEBUG nova.compute.manager [req-5d6f97c1-90b8-4cc1-858b-add901e53418 req-f56ea3e5-13dc-48b7-9706-cf7306fc44b5 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:13:24 user nova-compute[70709]: WARNING nova.compute.manager [req-5d6f97c1-90b8-4cc1-858b-add901e53418 req-f56ea3e5-13dc-48b7-9706-cf7306fc44b5 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received unexpected event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 28 01:13:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:25 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690506805.9302807, 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 => Resumed> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:13:25 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] VM Resumed (Lifecycle Event)
Jul 28 01:13:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Instance event wait completed in 0 seconds for  {{(pid=70709) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 28 01:13:25 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Guest created on hypervisor {{(pid=70709) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 28 01:13:25 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Instance spawned successfully.
Jul 28 01:13:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:13:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:13:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 01:13:25 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 28 01:13:25 user nova-compute[70709]: DEBUG nova.virt.driver [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] Emitting event <LifecycleEvent: 1690506805.93172, 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 => Started> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:13:25 user nova-compute[70709]: INFO nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] VM Started (Lifecycle Event)
Jul 28 01:13:25 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:13:26 user nova-compute[70709]: DEBUG nova.compute.manager [None req-6a7c3cfc-5003-4d2a-ac81-3a0506d3c21d None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70709) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 28 01:13:26 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-6c32d734-828d-4f52-ac3c-37d74feabb7a tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.525s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:13:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-ad833bd2-7597-41ec-af92-98017b45959b req-76fbfb58-ae8b-4b66-a40e-8f727602493a service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:13:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ad833bd2-7597-41ec-af92-98017b45959b req-76fbfb58-ae8b-4b66-a40e-8f727602493a service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:13:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ad833bd2-7597-41ec-af92-98017b45959b req-76fbfb58-ae8b-4b66-a40e-8f727602493a service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:13:27 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-ad833bd2-7597-41ec-af92-98017b45959b req-76fbfb58-ae8b-4b66-a40e-8f727602493a service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:13:27 user nova-compute[70709]: DEBUG nova.compute.manager [req-ad833bd2-7597-41ec-af92-98017b45959b req-76fbfb58-ae8b-4b66-a40e-8f727602493a service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:13:27 user nova-compute[70709]: WARNING nova.compute.manager [req-ad833bd2-7597-41ec-af92-98017b45959b req-76fbfb58-ae8b-4b66-a40e-8f727602493a service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received unexpected event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with vm_state active and task_state None.
Jul 28 01:13:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:28 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:13:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:13:43 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:48 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:53 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:13:55 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:13:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:13:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:13:55 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:13:55 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:13:55 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 01:13:56 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:13:56 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:13:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8886MB free_disk=25.1416015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:13:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:13:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:13:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 01:13:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:13:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:13:56 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:13:56 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:13:56 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:13:56 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:13:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:14:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:14:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:14:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:14:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:02 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:14:03 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:14:05 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:14:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:14:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:14:07 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:14:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:14:12 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:17 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:17 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:14:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:14:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:14:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:14:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:14:22 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:23 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:14:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:14:23 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:14:23 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:14:23 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Forcefully refreshing network info cache for instance {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 28 01:14:23 user nova-compute[70709]: DEBUG nova.objects.instance [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lazy-loading 'info_cache' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:14:24 user nova-compute[70709]: DEBUG nova.network.neutron [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:14:24 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:14:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updated the network info_cache for instance {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 28 01:14:27 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:14:32 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:14:37 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:42 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:14:47 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:14:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:14:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:14:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:14:52 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:57 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:14:57 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:14:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:14:57 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:14:57 user nova-compute[70709]: DEBUG nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70709) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 28 01:14:58 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:14:58 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:14:58 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8900MB free_disk=25.141006469726562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:14:58 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Instance 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70709) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 28 01:14:58 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:14:58 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:14:58 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:14:58 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:14:58 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:14:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:02 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-0ca52448-751a-4b10-8a8f-f28b7ed526c7 req-50e16c72-8370-42d0-a999-0b0643a71987 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-changed-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG nova.compute.manager [req-0ca52448-751a-4b10-8a8f-f28b7ed526c7 req-50e16c72-8370-42d0-a999-0b0643a71987 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Refreshing instance network info cache due to event network-changed-b91f8afb-e2d6-45d8-822a-b4a087b21f67. {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0ca52448-751a-4b10-8a8f-f28b7ed526c7 req-50e16c72-8370-42d0-a999-0b0643a71987 service nova] Acquiring lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0ca52448-751a-4b10-8a8f-f28b7ed526c7 req-50e16c72-8370-42d0-a999-0b0643a71987 service nova] Acquired lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG nova.network.neutron [req-0ca52448-751a-4b10-8a8f-f28b7ed526c7 req-50e16c72-8370-42d0-a999-0b0643a71987 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Refreshing network info cache for port b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:03 user nova-compute[70709]: INFO nova.compute.manager [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Terminating instance
Jul 28 01:15:03 user nova-compute[70709]: DEBUG nova.compute.manager [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Start destroying the instance on the hypervisor. {{(pid=70709) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:03 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-0ca52448-751a-4b10-8a8f-f28b7ed526c7 req-50e16c72-8370-42d0-a999-0b0643a71987 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updated VIF entry in instance network info cache for port b91f8afb-e2d6-45d8-822a-b4a087b21f67. {{(pid=70709) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG nova.network.neutron [req-0ca52448-751a-4b10-8a8f-f28b7ed526c7 req-50e16c72-8370-42d0-a999-0b0643a71987 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [{"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-0ca52448-751a-4b10-8a8f-f28b7ed526c7 req-50e16c72-8370-42d0-a999-0b0643a71987 service nova] Releasing lock "refresh_cache-5d78016f-795e-4c17-8d68-8faaf5e7fcb5" {{(pid=70709) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [-] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Instance destroyed successfully.
Jul 28 01:15:04 user nova-compute[70709]: DEBUG nova.objects.instance [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lazy-loading 'resources' on Instance uuid 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 {{(pid=70709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.vif [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-28T01:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-611965703',display_name='tempest-TestShelveInstance-server-611965703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-611965703',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYPPdUh4+tCJRVjmA5aLzp4QsludlGT7POfFeAD65gUZmnMU1u5A4U8rXHKZfqGfvRv4kpQGXRvgMFwK3SU8BGMHuD5Tqe/xnoPtyMpxKkVuuVWP7vXItwXtVI72XXR8g==',key_name='tempest-TestShelveInstance-339528514',keypairs=<?>,launch_index=0,launched_at=2023-07-28T01:13:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b17b1c29af647e7bd750c554a56522f',ramdisk_id='',reservation_id='r-lqfa0a1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1833749575',owner_user_name='tempest-TestShelveInstance-1833749575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-28T01:13:26Z,user_data=None,user_id='5a6244d73f8042d49b1d90b695a843e9',uuid=5d78016f-795e-4c17-8d68-8faaf5e7fcb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converting VIF {"id": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "address": "fa:16:3e:35:ce:ea", "network": {"id": "61ed389e-7906-40aa-b2e0-acb291defe4b", "bridge": "br-int", "label": "tempest-TestShelveInstance-885018006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b17b1c29af647e7bd750c554a56522f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb91f8afb-e2", "ovs_interfaceid": "b91f8afb-e2d6-45d8-822a-b4a087b21f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG nova.network.os_vif_util [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2') {{(pid=70709) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_vif [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2') {{(pid=70709) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb91f8afb-e2, bridge=br-int, if_exists=True) {{(pid=70709) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:04 user nova-compute[70709]: INFO os_vif [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:ce:ea,bridge_name='br-int',has_traffic_filtering=True,id=b91f8afb-e2d6-45d8-822a-b4a087b21f67,network=Network(61ed389e-7906-40aa-b2e0-acb291defe4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb91f8afb-e2')
Jul 28 01:15:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] calling os-brick to detach iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b9028f160>, {'target_iqn': 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDXIKybw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 28 01:15:04 user nova-compute[70709]: WARNING os_brick.initiator.connectors.base [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d69572-0727-42e6-87ef-0952ff461763]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 28 01:15:04 user nova-compute[70709]: No targets found.
Jul 28 01:15:04 user nova-compute[70709]: iSNS:
Jul 28 01:15:04 user nova-compute[70709]: No targets found.
Jul 28 01:15:04 user nova-compute[70709]: STATIC:
Jul 28 01:15:04 user nova-compute[70709]: Target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698
Jul 28 01:15:04 user nova-compute[70709]:         Portal: 172.16.0.220:3260,-1
Jul 28 01:15:04 user nova-compute[70709]:                 Iface Name: default
Jul 28 01:15:04 user nova-compute[70709]: FIRMWARE:
Jul 28 01:15:04 user nova-compute[70709]: No targets found.
Jul 28 01:15:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 28 01:15:04 user nova-compute[70709]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 28 01:15:04 user nova-compute[70709]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70709) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698', 0)] {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa80133-7721-4d86-a6be-143aae8de21f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35117b6-88e7-409b-9eb3-d937fc508cc3]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)
Jul 28 01:15:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 (non-flash)
Jul 28 01:15:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b9d0bacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698'): ({'sdb'}, set())}) {{(pid=70709) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Removing single pathed devices sdb {{(pid=70709) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc5cf94-6a4f-4aea-9f7d-5303d88c7b90]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eccd667-79d8-4a79-80ff-be67c9e331b9]: (4, ('ok\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Flushing IO for device /dev/sdb {{(pid=70709) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459b4b2-5b3f-4f60-9cca-0841f8b065c3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70709) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc9a6b9-b120-4857-9b8a-80c163f55251]: (4, ('1', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.linuxscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] SCSI volumes sdb have been removed. {{(pid=70709) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23765663762636165', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7a147e19', '/dev/disk/by-id/scsi-1SCST_BIO7a147e19-7ef7bcaee5f7c5a0') {{(pid=82455) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2eca71-bf29-4912-be4b-67c9fd1f4400]: (4, None) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698')] {{(pid=70709) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fc6531-9460-49df-840d-b75eb7dc0691]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --logout {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07bfe27-b365-4dc1-a16c-bb91da1d6fd1]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260]
Jul 28 01:15:04 user nova-compute[70709]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698, portal: 172.16.0.220,3260] successful.
Jul 28 01:15:04 user nova-compute[70709]:  stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op delete {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d04029-aae9-430c-b13a-b00ca76be698 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82455) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9f904c-97c4-422f-a944-f2711ad8b0f3]: (4, ('', '')) {{(pid=82455) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70709) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.base [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] <== disconnect_volume: return (348ms) None {{(pid=70709) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Disconnected iSCSI Volume {{(pid=70709) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 28 01:15:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Deleting instance files /opt/stack/data/nova/instances/5d78016f-795e-4c17-8d68-8faaf5e7fcb5_del
Jul 28 01:15:04 user nova-compute[70709]: INFO nova.virt.libvirt.driver [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Deletion of /opt/stack/data/nova/instances/5d78016f-795e-4c17-8d68-8faaf5e7fcb5_del complete
Jul 28 01:15:04 user nova-compute[70709]: INFO nova.compute.manager [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 28 01:15:04 user nova-compute[70709]: DEBUG oslo.service.loopingcall [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70709) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG nova.compute.manager [-] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Deallocating network for instance {{(pid=70709) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] deallocate_for_instance() {{(pid=70709) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.network.neutron [-] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Updating instance_info_cache with network_info: [] {{(pid=70709) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 28 01:15:05 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Took 0.60 seconds to deallocate network for instance.
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-3ad7093c-da45-4f6b-acc0-6189fae1445d req-a35f31ff-76ca-4a9b-ba3b-b9678b650c71 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-deleted-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-unplugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-unplugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-unplugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:15:05 user nova-compute[70709]: WARNING nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received unexpected event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with vm_state active and task_state deleting.
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:15:05 user nova-compute[70709]: WARNING nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received unexpected event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with vm_state active and task_state deleting.
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:15:05 user nova-compute[70709]: WARNING nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received unexpected event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with vm_state active and task_state deleting.
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-unplugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-unplugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [req-c2536473-f56a-4e5c-b64c-61030daa7d5c req-747eb9e4-d9fa-4ea0-8571-54d95d3a532e service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-unplugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with task_state deleting. {{(pid=70709) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:15:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:15:06 user nova-compute[70709]: INFO nova.compute.manager [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Took 0.91 seconds to detach 1 volumes for instance.
Jul 28 01:15:06 user nova-compute[70709]: DEBUG nova.compute.manager [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Deleting volume: 24d04029-aae9-430c-b13a-b00ca76be698 {{(pid=70709) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 28 01:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:15:06 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:15:06 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:06 user nova-compute[70709]: INFO nova.scheduler.client.report [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Deleted allocations for instance 5d78016f-795e-4c17-8d68-8faaf5e7fcb5
Jul 28 01:15:06 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-db36a456-4904-4543-9cbc-5f4b2b273dcc tempest-TestShelveInstance-1833749575 tempest-TestShelveInstance-1833749575-project-member] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.121s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:06 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:15:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-a345b4be-884e-47f0-958f-7045d88294ec req-b01a91e4-a2f1-4cee-b9a3-0acfb74600c2 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 28 01:15:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a345b4be-884e-47f0-958f-7045d88294ec req-b01a91e4-a2f1-4cee-b9a3-0acfb74600c2 service nova] Acquiring lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:15:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a345b4be-884e-47f0-958f-7045d88294ec req-b01a91e4-a2f1-4cee-b9a3-0acfb74600c2 service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:15:07 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [req-a345b4be-884e-47f0-958f-7045d88294ec req-b01a91e4-a2f1-4cee-b9a3-0acfb74600c2 service nova] Lock "5d78016f-795e-4c17-8d68-8faaf5e7fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:07 user nova-compute[70709]: DEBUG nova.compute.manager [req-a345b4be-884e-47f0-958f-7045d88294ec req-b01a91e4-a2f1-4cee-b9a3-0acfb74600c2 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] No waiting events found dispatching network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 {{(pid=70709) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 28 01:15:07 user nova-compute[70709]: WARNING nova.compute.manager [req-a345b4be-884e-47f0-958f-7045d88294ec req-b01a91e4-a2f1-4cee-b9a3-0acfb74600c2 service nova] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Received unexpected event network-vif-plugged-b91f8afb-e2d6-45d8-822a-b4a087b21f67 for instance with vm_state deleted and task_state None.
Jul 28 01:15:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:09 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:15:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:15:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:15:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:15:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:15:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:15:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:15:19 user nova-compute[70709]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690506904.3559895, 5d78016f-795e-4c17-8d68-8faaf5e7fcb5 => Stopped> {{(pid=70709) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 28 01:15:19 user nova-compute[70709]: INFO nova.compute.manager [-] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] VM Stopped (Lifecycle Event)
Jul 28 01:15:19 user nova-compute[70709]: DEBUG nova.compute.manager [None req-34c12b8b-2262-4623-a111-09c8515622bd None None] [instance: 5d78016f-795e-4c17-8d68-8faaf5e7fcb5] Checking state {{(pid=70709) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 28 01:15:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:20 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:15:24 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:24 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:15:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Starting heal instance info cache {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 28 01:15:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Rebuilding the list of instances to heal {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 28 01:15:24 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Didn't find any instances for network info cache update. {{(pid=70709) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 28 01:15:29 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:15:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:15:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:15:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:15:34 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:39 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:44 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:49 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:15:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70709) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 28 01:15:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:15:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70709) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 28 01:15:54 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:55 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:56 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:15:57 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:15:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:15:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:15:57 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:57 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Auditing locally available compute resources for user (node: user) {{(pid=70709) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 28 01:15:58 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:15:58 user nova-compute[70709]: WARNING nova.virt.libvirt.driver [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 28 01:15:58 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.13977813720703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70709) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 28 01:15:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 28 01:15:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 28 01:15:58 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 28 01:15:58 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70709) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 28 01:15:58 user nova-compute[70709]: DEBUG nova.compute.provider_tree [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed in ProviderTree for provider: 4612f42c-a702-4177-9388-c9bc6a4c0da1 {{(pid=70709) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 28 01:15:58 user nova-compute[70709]: DEBUG nova.scheduler.client.report [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Inventory has not changed for provider 4612f42c-a702-4177-9388-c9bc6a4c0da1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70709) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 28 01:15:58 user nova-compute[70709]: DEBUG nova.compute.resource_tracker [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Compute_service record updated for user:user {{(pid=70709) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 28 01:15:58 user nova-compute[70709]: DEBUG oslo_concurrency.lockutils [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=70709) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 28 01:15:59 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:16:00 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:16:04 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:16:04 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:16:05 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:16:05 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70709) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 28 01:16:07 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:16:08 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:16:09 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 28 01:16:10 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:16:11 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:16:14 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:16:18 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:16:19 user nova-compute[70709]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70709) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 28 01:16:22 user nova-compute[70709]: DEBUG oslo_service.periodic_task [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70709) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 28 01:16:22 user nova-compute[70709]: DEBUG nova.compute.manager [None req-bfe87edf-bb76-4f44-8078-914e56d33aa4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70709) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}